-- Logs begin at Fri 2022-09-02 20:22:50 UTC, end at Fri 2022-09-02 21:47:15 UTC. -- Sep 02 21:14:57.359032 dv-cinder-852211-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 21:14:57.372516 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 21:14:57 2022] *** Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: nodename: dv-cinder-852211-9-iscsi Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: machine: x86_64 Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: clock source: unix Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: pcre jit disabled Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: detected number of CPU cores: 4 Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: current working directory: / Sep 02 21:14:57.375020 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: detected binary path: /usr/bin/uwsgi-core Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: your processes number limit is 47680 Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: your memory page size is 4096 bytes Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: detected max file descriptor number: 2048 Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: lock engine: pthread robust mutexes Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: thunder lock: enabled Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 21:14:57.377542 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 21:14:57.418872 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: Python main interpreter initialized at 0x561b583bb9c0 Sep 02 21:14:57.418872 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: python threads support enabled Sep 02 21:14:57.418872 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: your server socket listen backlog is limited to 100 connections Sep 02 21:14:57.418872 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: your mercy for graceful operations on workers is 90 seconds Sep 02 21:14:57.419430 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 21:14:57.419430 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: *** Operational MODE: preforking *** Sep 02 21:14:57.423437 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: *** uWSGI is running in multiple interpreter mode *** Sep 02 21:14:57.423437 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: spawned uWSGI master process (pid: 106233) Sep 02 21:14:57.423437 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: spawned uWSGI worker 1 (pid: 106234, cores: 1) Sep 02 21:14:57.423437 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: spawned uWSGI worker 2 (pid: 106235, cores: 1) Sep 02 21:14:57.423437 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 21:14:57.419803 dv-cinder-852211-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 21:14:58.127182 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:14:58.254245 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:14:59.276776 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:14:59.276776 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: from cryptography.utils import int_from_bytes Sep 02 21:14:59.277882 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:14:59.277882 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: from cryptography.utils import int_from_bytes Sep 02 21:14:59.552617 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:14:59.552617 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: from cryptography.utils import int_from_bytes Sep 02 21:14:59.553494 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:14:59.553494 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: from cryptography.utils import int_from_bytes Sep 02 21:15:01.941127 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:15:01.941698 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:15:01.941879 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:15:01.942192 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:15:01.942450 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:15:01.942845 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.943172 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.943490 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.943807 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.944141 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.944443 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.944766 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.945097 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.945426 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.945686 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.946031 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.946353 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-9-iscsi {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.946677 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.946982 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.947300 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.947622 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.947925 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.948246 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.948559 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.949062 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.949508 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.949918 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.950236 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.950582 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.951076 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.951225 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.951501 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.951813 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.952137 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.952447 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.952866 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-9-iscsi {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.953193 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.954117 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.954519 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.954968 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.955317 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.955630 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.955953 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.956276 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.956589 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.956920 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.957244 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.957564 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.957919 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.958261 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.958570 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.958882 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.959207 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.959511 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.959817 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.960067 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.960375 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.960694 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.961014 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.961338 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.961628 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.961914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.962238 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.962557 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.962865 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.963170 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.963474 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.963778 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.964081 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.964384 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.964686 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.964989 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.965316 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.965628 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.965978 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.966287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.966610 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.967011 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.967269 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.967577 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.967922 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.968239 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.968549 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.968921 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.969326 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.969618 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.969959 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.970268 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.970587 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.970925 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.971232 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.971486 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.971789 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.972095 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.972414 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.972721 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.973026 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.973331 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.973632 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.973964 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.974269 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.974603 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.974877 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.975595 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.975908 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.976222 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.976529 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.976844 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.977149 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.977479 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.977830 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.978139 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.978442 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.978746 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.979056 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.979373 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.979679 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.979982 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.980303 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.980608 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.980911 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.981228 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.981752 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.982075 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.982400 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.982706 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.983072 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.984565 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.984798 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.985483 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.985897 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.986239 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.986560 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.986882 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.987196 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.987500 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.987809 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.988145 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.988458 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.988769 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.989076 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.989384 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.989705 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:01.990076 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.990413 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.990755 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.991068 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.991405 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.991733 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.992053 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.992629 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.992947 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.993272 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.993578 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.993926 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.994236 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.994553 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.994871 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.995198 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.995514 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.995827 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.996145 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.996460 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.996779 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.997102 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.997420 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.997745 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.998094 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.998452 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.998771 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.999097 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.999428 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:01.999740 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.000043 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.001046 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.001553 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.001940 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.002259 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.002592 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.002909 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.003238 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.003547 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.003866 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.004171 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.004483 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.004802 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.005138 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.005459 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.005814 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.006138 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.006457 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.006769 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.007081 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.007391 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.007701 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.008005 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.008313 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.008621 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.008931 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.009235 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.009555 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.009912 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.010223 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.010560 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.010868 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.011178 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.011491 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.011803 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.012111 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.012423 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.012737 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.013046 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.013372 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.013684 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.014030 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.014356 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.014662 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.014969 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.015287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.015593 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.016735 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.017046 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.017360 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.017690 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.018025 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.018338 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.018675 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.019017 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.019326 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.019654 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.019975 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.020293 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.020597 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.020912 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.021217 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.021521 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.021856 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.022163 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.022467 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.022776 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.023084 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.023384 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.023682 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.024013 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.024316 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.024622 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.024927 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.025228 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.025572 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.025903 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.026257 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.026595 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.026922 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.027280 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.027595 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.027922 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.028232 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.028545 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.028846 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.029161 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.029486 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.029831 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.030149 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.030465 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.030799 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.031113 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.031543 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.031859 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.032182 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.032564 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.032873 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.033164 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.033494 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.033833 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.034153 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.034468 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.034780 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.035093 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.035403 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.035722 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.036034 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.036355 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.036665 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.037002 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.037310 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.037629 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.037960 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.038277 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.038612 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.038944 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.039256 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.039569 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.039892 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.040197 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.040507 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.040816 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.041122 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.041432 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.041759 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.042074 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.042386 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.042700 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.042996 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.043315 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.043621 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.043927 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.044230 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.044544 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.044952 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.045275 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.045599 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.046025 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.046334 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.046633 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.047375 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.047375 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.047777 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.047885 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.048191 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.048535 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.048853 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.049159 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.049472 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.049814 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.050136 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.050455 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.050770 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.051114 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.051436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.051762 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.052074 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.052418 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.052731 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.053042 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.053353 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.053676 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.054019 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.054332 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.054644 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.054948 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.055259 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.055578 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.056164 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.056496 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.056815 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.057157 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.057479 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.057819 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.058151 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.058480 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.058796 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.059095 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.059404 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.059709 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.060018 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.060333 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.060631 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.060935 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.061238 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.061548 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.061887 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.062254 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.062562 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.066241 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.067324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.067324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.067324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.067324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.067324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.068009 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.068009 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.068290 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.068525 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.068857 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.069148 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.069451 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.069775 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.070095 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.070404 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.070702 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.071016 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.071324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.071634 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.071956 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.072237 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.072546 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.072849 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.073166 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.073467 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.073798 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.074104 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.074413 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.074714 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.075020 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.075333 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.075637 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.075958 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.076257 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.076565 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.076869 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.077173 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.077481 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.077812 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.078138 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.079188 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.079622 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.080025 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.080353 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.080542 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.080846 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.081163 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.081487 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.081834 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.082138 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.082451 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.082756 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.083061 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.083364 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.083664 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.083970 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.084272 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.084576 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.084876 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.085177 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.085506 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.085841 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.086153 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.086312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:15:02.086998 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:15:02.087152 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.087152 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.087297 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:15:02.087363 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.087497 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:15:02.087623 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.087785 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:15:02.087928 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.088123 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.088265 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.088406 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.088521 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.088624 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.088760 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.088903 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.088992 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.089215 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.089312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.089529 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.089674 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.089865 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.089952 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.090183 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.090308 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.090493 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.090579 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.090808 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.090894 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.091113 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.091214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.091419 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.091504 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-9-iscsi {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.091744 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.091828 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.092058 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.092187 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.092396 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.092494 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.092686 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.092772 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.092994 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.093080 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.093324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.093409 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.093626 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.093754 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.094087 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.094313 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.094535 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.094622 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.094774 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.094925 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.095086 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.095327 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.095419 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.095683 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.095768 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.095998 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.096091 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.096309 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.096402 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.096620 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.096714 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.096929 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.097016 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.097240 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.097324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.097563 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.097803 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.097953 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.098084 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-9-iscsi {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.098211 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.098345 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.098480 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.098655 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.098790 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.098979 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.099093 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.099404 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.099492 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.099710 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.099853 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.100016 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.100116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.100320 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.100441 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.100650 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.100746 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.100966 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.101061 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.101297 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.101383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.101623 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.101730 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.101975 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.102074 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.102285 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.102383 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.102593 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.102697 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.102903 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.102997 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.103207 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.103300 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.103525 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.103609 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.103838 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.103925 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.104148 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.104233 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.104403 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.104511 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.104718 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.104805 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.105045 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.105139 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.105372 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.105465 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.105707 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.105843 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.105985 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.106083 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.106240 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.106428 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.106562 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.106755 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.106891 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.107081 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.107205 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.107388 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.107518 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.107710 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.107831 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.108135 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.108222 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.108445 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.108530 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.108748 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.108840 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.109057 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.109158 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.109370 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.109474 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.109856 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.109990 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.110148 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.110319 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.110473 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.110748 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.110860 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.111070 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.111169 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.111394 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.111479 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.111703 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.111788 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.112026 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.112121 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.112349 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.112478 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.112671 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.112840 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.112994 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.113146 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.113293 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.113428 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.113589 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.113678 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.113939 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.114027 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.114260 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.114344 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.114572 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.114658 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.114888 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.114992 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.115210 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.115303 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.115552 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.115646 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.115877 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.115992 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.116131 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.116225 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.116443 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.116576 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.116763 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.116873 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.117085 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.117179 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.117959 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.118047 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.118191 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.118396 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.118396 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.118546 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.118614 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.118680 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.118870 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.119032 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.119176 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.119264 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.119483 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.119580 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.119789 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.119887 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.120101 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.120190 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.120396 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.120498 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.120701 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.120789 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.121011 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.121238 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.121311 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.121388 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.121623 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.121742 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.121964 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.122057 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.122270 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.122373 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.122583 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.122674 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.122891 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.123005 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.123190 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.123288 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.123492 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.123582 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.123793 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.123965 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.124135 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.124238 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.124439 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.124535 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.124757 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.124846 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.125067 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.125873 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.125999 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.126075 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.126325 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.126420 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.126612 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.126692 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.126925 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.127024 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.127248 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.127335 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.127552 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.127647 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.127864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.127950 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.128185 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.128274 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.128493 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.128582 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.128796 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.128891 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.129098 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.129192 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.129400 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.129488 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.129703 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.129830 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.130029 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.130131 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.130333 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.130411 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.130631 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.130724 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.130935 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.131050 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.131279 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.131379 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.131549 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.131642 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.131849 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.131949 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.132162 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.132249 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.132466 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.132553 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.132767 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.132855 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:15:02.133077 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.133201 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.133372 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.133462 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.133737 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.133829 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134044 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134135 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134373 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134461 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134688 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.134777 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135009 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135096 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135323 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135410 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135634 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135723 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.135947 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136043 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136258 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136359 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136568 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136668 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136878 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.136965 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.137692 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.137927 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.138210 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.138713 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139030 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139121 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139200 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139279 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139440 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139538 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139538 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139658 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139733 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139885 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.139969 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.140037 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.147890 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.148159 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.148340 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.148491 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.148657 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.148914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149080 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149233 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149410 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149410 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149691 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.149967 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150119 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150262 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150434 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150581 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150787 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.150937 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151084 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151229 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151387 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151579 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151740 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.151886 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152042 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152204 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152349 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152492 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152633 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152794 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.152936 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153094 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153222 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153345 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153484 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153633 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153832 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.153977 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154122 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154274 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154429 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154732 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.154877 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155025 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155166 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155302 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155440 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155614 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155757 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.155915 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.156060 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.156214 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.156349 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.156997 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.157126 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.160276 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.160461 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.160610 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.160780 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.160988 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.161167 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.161326 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.161476 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.162356 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.162540 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.162687 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.162822 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.162954 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163094 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163239 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163383 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163499 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163801 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.163801 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.164069 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.164203 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.164361 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.164497 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.166335 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.166501 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.166676 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.166850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.166998 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.167151 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.167294 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.167443 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.167812 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.167973 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168117 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168311 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168453 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168603 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168755 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.168921 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169070 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169219 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169366 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169528 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169687 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.169955 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170103 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170259 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170407 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170551 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170710 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.170858 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171002 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171002 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171238 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171368 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171525 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171669 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171823 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.171960 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.172659 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.172788 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.172929 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173078 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173234 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173380 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173519 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173650 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173846 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.173993 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174136 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174294 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174451 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174609 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174756 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.174897 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175037 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175183 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175339 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175498 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175655 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175800 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.175947 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176091 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176233 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176393 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176536 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176672 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176820 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.176962 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177111 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177263 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177404 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177546 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177686 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.177917 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178082 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178224 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178385 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178526 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178655 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178794 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.178943 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179082 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179234 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179378 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179533 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179675 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179834 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.179978 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180122 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180266 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180266 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180538 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180696 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180838 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.180992 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181137 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181347 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181507 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181654 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181839 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.181973 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182109 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182237 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182477 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182628 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182771 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.182896 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183021 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183163 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183319 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183473 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183635 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183765 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.183906 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184051 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184221 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184366 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184517 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184651 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184785 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.184933 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185083 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185225 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185369 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185369 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185624 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185820 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.185971 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186198 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186317 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186437 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186569 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186694 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186813 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.186934 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187077 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187228 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187228 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187511 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187651 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187791 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.187934 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188096 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188336 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188485 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188630 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188837 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.188987 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189141 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189286 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189431 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189576 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189777 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.189923 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190086 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190240 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190381 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190532 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190672 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190822 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.190983 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.191120 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.191329 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.191540 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.191691 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.191849 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192004 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192147 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192288 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192415 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192570 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192732 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.192877 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193072 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193233 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193376 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193519 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193662 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.193913 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194063 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194203 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194350 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194489 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194631 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194787 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.194943 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195100 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195238 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195375 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195525 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195658 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195805 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.195950 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196085 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196232 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196371 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196515 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196515 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196765 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.196901 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197040 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197175 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197333 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197475 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197624 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197790 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.197934 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198075 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198236 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198376 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198512 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198653 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.198791 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199004 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199168 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199305 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199446 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199446 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199701 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.199861 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200007 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200161 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200314 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200458 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200600 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200764 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.200907 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201056 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201199 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201348 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201487 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201697 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.201893 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202037 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202180 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202324 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202550 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202699 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202841 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202998 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.202998 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.203659 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204077 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204229 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204376 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204522 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204665 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204812 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.204971 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205136 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205295 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205439 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205579 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205746 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.205903 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206049 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206206 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206349 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206491 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206650 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206792 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.206934 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207100 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207243 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207243 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207530 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207673 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207812 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.207949 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208084 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208230 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208380 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208532 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208682 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208833 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.208988 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209126 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209269 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209269 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209510 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209642 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.209900 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210061 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210204 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210343 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210492 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210632 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.210949 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211115 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211259 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211406 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211547 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211687 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.211892 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212049 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212190 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212332 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212482 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212673 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212820 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.212974 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213112 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213250 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213391 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213531 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213666 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.213847 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214009 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214152 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214342 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214459 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214619 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214752 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.214883 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215024 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215163 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215311 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215451 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215591 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215728 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.215880 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216020 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216158 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216305 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216305 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216565 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216707 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216846 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.216984 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.217142 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.217283 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.217431 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.217568 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.217809 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218044 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218199 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218341 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218481 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218637 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.218790 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.219441 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.219572 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.219706 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.219824 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.219950 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220076 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220223 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220356 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220495 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220638 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220780 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.220957 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221115 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221257 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221400 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221538 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221675 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.221864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222069 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222212 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222355 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222495 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222636 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222848 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.222993 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223135 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223273 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223426 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223578 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223719 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223857 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.223995 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224132 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.224276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.225324 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226253 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.226864 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.227850 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.228778 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.229782 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.230800 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.230800 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.230800 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.230800 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.231313 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.231457 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.231718 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.232042 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.232358 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.232686 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.233013 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.233342 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.233651 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.233998 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.234314 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.235245 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.235577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.235893 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.236215 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.236537 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.236856 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.237180 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.237498 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.237843 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.238167 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.238485 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.238797 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.239136 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.239452 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.239761 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.240076 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.240386 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.240703 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.241020 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.241471 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.241819 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.242564 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.242769 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.243027 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.243343 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.243670 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.243993 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.244321 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.244769 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.245089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.245408 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.245810 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.246063 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.246376 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.246692 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.247032 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.247344 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.247653 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.247956 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.248283 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.248601 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.248922 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.249368 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.249690 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.250039 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.250546 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.251003 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.251495 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.251835 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.252168 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.252506 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.252826 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.253152 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.253471 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.253865 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.254174 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.254498 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.254824 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.255138 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.255469 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.255799 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.256122 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.256449 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.256904 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.257233 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.257558 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.257919 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.258254 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.258564 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.258874 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.259191 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.259500 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.259813 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.260145 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.260454 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.260773 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.261091 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.261461 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.261797 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.262116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.262449 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.262762 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.263090 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.263416 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.263745 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.264076 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.264388 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.264713 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.265031 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.265344 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.265657 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.266607 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.267240 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.267661 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.267998 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.268346 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.268690 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.269011 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.269359 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.269699 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.270024 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.270383 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.270715 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.271054 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.271367 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.271679 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.272059 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.272378 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.272690 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.272998 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.273319 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.273630 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.273973 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.274287 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.274628 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.274941 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.275269 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.275589 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.275899 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.276213 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.276522 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.276888 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.277199 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.277538 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.277881 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.278213 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.278537 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.278858 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.279209 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.279532 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.279855 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.280176 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.280497 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.280815 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.281136 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.282100 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.282425 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.283023 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.283364 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.283685 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.284007 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.284329 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.284654 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.284972 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.285292 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.285610 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.285958 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.286276 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.286630 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.286966 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.287298 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.287646 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.287976 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.288303 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.288624 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.288945 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.289320 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.289643 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.290047 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.290409 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.290846 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.291167 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.291489 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.291807 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.292128 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.292448 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.292771 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.293087 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.293409 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.293760 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.294092 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.294442 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.294777 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.295099 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.295420 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.295744 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.296329 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.296651 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.297027 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.297467 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.297859 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.298188 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.298514 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.298852 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.299165 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.299476 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.299794 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.300109 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.300420 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.300834 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.301155 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.301467 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.301836 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.302156 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.302758 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.303119 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.303443 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.303776 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.304110 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.304435 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.304746 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.305077 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.305390 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.305700 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.306049 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.306369 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.306685 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.306992 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.307312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.307626 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.307934 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.308251 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.308561 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.308896 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.309207 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.309857 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.310176 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.310484 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.310794 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.311148 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.311458 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.311775 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.312083 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.312401 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.312744 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.313174 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.313562 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.314012 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.314329 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.314671 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.314987 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.315299 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.315635 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.315952 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.316282 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.316606 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.316929 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.317315 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.317641 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.318293 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.318638 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.318968 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.319317 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.319657 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.319964 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.320278 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.320587 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.320923 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.321244 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.321560 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.321907 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.322229 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.322540 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.322852 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.323167 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.323487 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.323802 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.324114 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.324430 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.324742 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.325075 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.325389 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.325733 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.326097 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.326436 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.326757 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.327080 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.327400 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.327716 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.328031 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.328982 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.329462 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.329833 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.330181 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.330503 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.330816 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.331544 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.331887 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.332189 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.332516 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.332835 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.333162 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.333494 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.333845 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.334211 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.334490 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.334828 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.335176 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.335558 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.335843 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.336154 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.336464 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.336774 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.337095 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.337420 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.337758 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.338068 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.338381 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.338693 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.339002 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.339312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.339617 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.339920 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.340232 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.340539 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.340844 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.341169 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.341463 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.341803 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.342115 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.342461 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.342775 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.343085 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.343402 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.343711 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.344102 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.344444 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.344793 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.345116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.345442 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.345784 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.346111 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.346427 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.346759 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.347086 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.347411 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.347717 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.348058 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.348377 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.348690 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.349004 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.349318 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.349629 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.349979 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.350300 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.350697 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.351008 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.351334 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.351657 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.351982 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.352308 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.352626 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.352960 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.353304 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.353642 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.353986 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.354307 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.354625 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.354949 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.355266 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.355584 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.355906 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.356228 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.356559 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.356898 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.357214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.357539 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.357898 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.358259 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.358578 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.358928 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.359288 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.360187 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.360508 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.360822 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:15:02.361070 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:15:02.369571 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO dbcounter [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Registered counter for database nova_api Sep 02 21:15:02.394190 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.402056 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writer thread running {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.468245 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.context [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee6d477e-b8ad-480a-9130-23ff2ba2795f(cell1) {{(pid=106234) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:15:02.473045 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:15:02.473780 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:15:02.475479 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:15:02.476288 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:15:02.476798 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:15:02.479032 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:15:02.481545 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO dbcounter [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Registered counter for database nova_cell0 Sep 02 21:15:02.486968 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO dbcounter [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Registered counter for database nova_cell1 Sep 02 21:15:02.496443 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.498756 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.505152 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writer thread running {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.508240 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writer thread running {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.517787 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO dbcounter [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Registered counter for database nova_api Sep 02 21:15:02.540986 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_db.sqlalchemy.engines [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.553793 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writer thread running {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.655867 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.context [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee6d477e-b8ad-480a-9130-23ff2ba2795f(cell1) {{(pid=106235) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:15:02.660974 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:15:02.662346 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:15:02.663263 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:15:02.664275 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:15:02.664740 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:15:02.666888 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_concurrency.lockutils [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:15:02.669094 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO dbcounter [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Registered counter for database nova_cell0 Sep 02 21:15:02.671404 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO dbcounter [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Registered counter for database nova_cell0 Sep 02 21:15:02.674884 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO dbcounter [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Registered counter for database nova_cell1 Sep 02 21:15:02.681940 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.683859 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_db.sqlalchemy.engines [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.688999 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_db.sqlalchemy.engines [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.689316 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writer thread running {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.693584 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writer thread running {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.842055 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writer thread running {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:02.855366 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO dbcounter [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Registered counter for database nova_cell0 Sep 02 21:15:02.865617 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG oslo_db.sqlalchemy.engines [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:15:02.871248 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writer thread running {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:15:03.181200 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: WARNING keystonemiddleware.auth_token [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:15:03.188770 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: WARNING keystonemiddleware.auth_token [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:15:03.225249 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: WARNING keystonemiddleware.auth_token [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:15:03.232934 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: WARNING keystonemiddleware.auth_token [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:15:03.543017 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: WARNING keystonemiddleware.auth_token [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:15:03.549500 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: WARNING keystonemiddleware.auth_token [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:15:03.555655 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b583bb9c0 pid: 106234 (default app) Sep 02 21:15:03.557996 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:03.559269 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] 10.222.0.99 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001985 Sep 02 21:15:03.559724 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 788 bytes} [Fri Sep 2 21:15:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:03.592449 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: WARNING keystonemiddleware.auth_token [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:15:03.599019 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: WARNING keystonemiddleware.auth_token [None req-5a3dede3-40de-49fe-9abc-1d6011330de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:15:03.604590 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b583bb9c0 pid: 106235 (default app) Sep 02 21:16:45.062038 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:45.063686 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Sep 02 21:16:45.064102 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 2/2] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:16:45.085518 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_api:SELECT=3 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:45.092518 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_cell0:SELECT=3 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:45.092518 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_cell1:SELECT=3 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:45.092518 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_cell0:SELECT=3 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:46.424996 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-66c6303e-4375-4043-8eb9-b23ad1935c13 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:46.461631 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-66c6303e-4375-4043-8eb9-b23ad1935c13 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.388463 Sep 02 21:16:46.462493 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 1/3] 10.222.0.99 () {60 vars in 1292 bytes} [Fri Sep 2 21:16:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:16:49.651106 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:49.652699 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-0f1ebab2-42e2-41c7-8e3b-e880ca8b8ae5 None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002594 Sep 02 21:16:49.653400 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 3/4] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:16:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:50.193596 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-6da2a0e5-b9d1-4075-86aa-f49d97cb09ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:50.310109 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-6da2a0e5-b9d1-4075-86aa-f49d97cb09ae admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.645563 Sep 02 21:16:50.313755 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 2/5] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:16:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:16:50.557900 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-a1fd3dde-5862-4a45-8d4a-4d672d411e6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:50.580972 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=3 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:50.580972 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_cell0:SELECT=3 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:50.581659 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_cell1:SELECT=3 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:50.582506 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:50.738464 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-a1fd3dde-5862-4a45-8d4a-4d672d411e6d admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.417948 Sep 02 21:16:50.739906 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 4/6] 10.222.0.99 () {64 vars in 1336 bytes} [Fri Sep 2 21:16:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:16:53.481455 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-6da2a0e5-b9d1-4075-86aa-f49d97cb09ae admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:53.483310 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-6da2a0e5-b9d1-4075-86aa-f49d97cb09ae admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002622 Sep 02 21:16:53.484245 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 3/7] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:54.506703 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-fa956760-d8fe-42c1-ab3c-3939f15c1744 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "id": "d1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:54.707179 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-fa956760-d8fe-42c1-ab3c-3939f15c1744 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.214653 Sep 02 21:16:54.709148 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 5/8] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:16:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:16:54.731458 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-7ab929ed-857f-45f9-a0f3-c50edb147e4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:54.955358 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-7ab929ed-857f-45f9-a0f3-c50edb147e4d admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.231767 Sep 02 21:16:54.956956 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 4/9] 10.222.0.99 () {64 vars in 1336 bytes} [Fri Sep 2 21:16:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:16:57.692014 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-fa956760-d8fe-42c1-ab3c-3939f15c1744 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:57.693143 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-fa956760-d8fe-42c1-ab3c-3939f15c1744 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Sep 02 21:16:57.693566 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 6/10] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:16:58.291515 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-c0ddc49c-905a-4f2f-85ed-9c8b5fc99f95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:58.390983 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-c0ddc49c-905a-4f2f-85ed-9c8b5fc99f95 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689771 Sep 02 21:16:58.391886 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 5/11] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:16:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:16:58.413187 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-9159986d-4042-4602-a59f-b35f8cc6c8d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:58.520743 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-9159986d-4042-4602-a59f-b35f8cc6c8d2 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114785 Sep 02 21:16:58.521399 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 7/12] 10.222.0.99 () {64 vars in 1336 bytes} [Fri Sep 2 21:16:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:01.193946 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-c0ddc49c-905a-4f2f-85ed-9c8b5fc99f95 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:01.195541 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-c0ddc49c-905a-4f2f-85ed-9c8b5fc99f95 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003135 Sep 02 21:17:01.196030 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 6/13] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:01.772103 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-b4211302-9a66-44bc-b556-008f032a4b56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:01.873268 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-b4211302-9a66-44bc-b556-008f032a4b56 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.668277 Sep 02 21:17:01.874811 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 8/14] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:17:01.900429 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-4d23bd0f-26d7-4581-80ef-29c20073f7e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:02.014288 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-4d23bd0f-26d7-4581-80ef-29c20073f7e1 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122586 Sep 02 21:17:02.015702 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 7/15] 10.222.0.99 () {64 vars in 1336 bytes} [Fri Sep 2 21:17:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:05.230182 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-b4211302-9a66-44bc-b556-008f032a4b56 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:05.231352 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-b4211302-9a66-44bc-b556-008f032a4b56 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Sep 02 21:17:05.231959 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 9/16] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:17:05.834905 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:05.929122 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689640 Sep 02 21:17:05.930044 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 8/17] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:17:05.945173 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-2dd16d9a-0d13-4647-99d8-852d8a7b5c41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:06.073068 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-2dd16d9a-0d13-4647-99d8-852d8a7b5c41 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132340 Sep 02 21:17:06.073891 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 10/18] 10.222.0.99 () {64 vars in 1336 bytes} [Fri Sep 2 21:17:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:09.304619 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:09.306394 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002418 Sep 02 21:17:09.306976 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 9/19] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:10.044331 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-fd713c1d-1798-4e98-bd4b-90ada67218c4 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:10.087310 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-fd713c1d-1798-4e98-bd4b-90ada67218c4 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.770136 Sep 02 21:17:10.089062 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 11/20] 10.222.0.99 () {60 vars in 1292 bytes} [Fri Sep 2 21:17:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:13.764629 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:13.766490 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-f4cbf450-95ab-4a2b-b0b6-c373b966e73e admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002525 Sep 02 21:17:13.767268 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 10/21] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:14.362831 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f6d9780d-ad77-4e02-9197-8f9fac30cec4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:14.471221 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-f6d9780d-ad77-4e02-9197-8f9fac30cec4 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.696690 Sep 02 21:17:14.471992 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 12/22] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:17:14.487262 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-78cd7d6d-b756-4873-b0ee-f2917b9fe752 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:14.614373 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-78cd7d6d-b756-4873-b0ee-f2917b9fe752 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131021 Sep 02 21:17:14.620389 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 11/23] 10.222.0.99 () {64 vars in 1333 bytes} [Fri Sep 2 21:17:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:17.862858 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f6d9780d-ad77-4e02-9197-8f9fac30cec4 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:17.864174 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-f6d9780d-ad77-4e02-9197-8f9fac30cec4 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 02 21:17:17.864582 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 13/24] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:18.417569 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-9e69add8-8554-4bcd-82ca-4e9ba0a1a660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:18.428182 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:18.526622 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-9e69add8-8554-4bcd-82ca-4e9ba0a1a660 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.653720 Sep 02 21:17:18.527374 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 12/25] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:17:18.546244 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-ef2f342b-94e7-43b6-b6c9-aa715b7d6fd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:18.658569 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-ef2f342b-94e7-43b6-b6c9-aa715b7d6fd4 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117630 Sep 02 21:17:18.659265 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 14/26] 10.222.0.99 () {64 vars in 1333 bytes} [Fri Sep 2 21:17:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:21.398704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-9e69add8-8554-4bcd-82ca-4e9ba0a1a660 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:21.401336 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-9e69add8-8554-4bcd-82ca-4e9ba0a1a660 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003976 Sep 02 21:17:21.402874 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 13/27] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:22.049848 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-15d30840-61a3-49ef-be45-5d07b18ffbbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:22.314150 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-15d30840-61a3-49ef-be45-5d07b18ffbbb admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.905106 Sep 02 21:17:22.317191 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 15/28] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:17:22.336797 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-6004e2c5-93f3-4a6d-92b4-a2d94bcb036b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:22.475542 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-6004e2c5-93f3-4a6d-92b4-a2d94bcb036b admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144566 Sep 02 21:17:22.478435 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 14/29] 10.222.0.99 () {64 vars in 1333 bytes} [Fri Sep 2 21:17:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:25.349819 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-15d30840-61a3-49ef-be45-5d07b18ffbbb admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:25.352432 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-15d30840-61a3-49ef-be45-5d07b18ffbbb admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003081 Sep 02 21:17:25.353458 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 16/30] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:26.016015 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-a4aa3b0e-ae1d-406a-830e-64f4d9bb2aa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "4"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:26.122433 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-a4aa3b0e-ae1d-406a-830e-64f4d9bb2aa9 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.756757 Sep 02 21:17:26.123301 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 15/31] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:17:26.136860 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-eeb7303c-e1f4-42f3-b8ed-8221cff61660 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:26.143259 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:26.265523 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-eeb7303c-e1f4-42f3-b8ed-8221cff61660 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132997 Sep 02 21:17:26.266959 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 17/32] 10.222.0.99 () {64 vars in 1333 bytes} [Fri Sep 2 21:17:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:17:29.232720 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-a4aa3b0e-ae1d-406a-830e-64f4d9bb2aa9 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:29.235116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-a4aa3b0e-ae1d-406a-830e-64f4d9bb2aa9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003333 Sep 02 21:17:29.235866 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 16/33] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:29.988196 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge"}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:30.080330 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.836576 Sep 02 21:17:30.081414 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 18/34] 10.222.0.99 () {64 vars in 1283 bytes} [Fri Sep 2 21:17:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:17:30.099638 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-f404bea1-1581-4970-93ca-85b47565f45e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:30.205341 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-f404bea1-1581-4970-93ca-85b47565f45e admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108701 Sep 02 21:17:30.206558 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 17/35] 10.222.0.99 () {64 vars in 1333 bytes} [Fri Sep 2 21:17:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:48.530341 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:48.531355 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 02 21:17:48.531766 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 19/36] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:17:48.544596 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:49.031327 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-7153fb3f-4df3-4dc8-b0bd-744c0012fadd admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:49.051550 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-7153fb3f-4df3-4dc8-b0bd-744c0012fadd admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.511491 Sep 02 21:17:49.052126 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 18/37] 10.222.0.99 () {60 vars in 1292 bytes} [Fri Sep 2 21:17:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:50.248819 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:50.250296 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-ea56f2d9-55d7-45a6-90de-dc983a91ab97 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002341 Sep 02 21:17:50.250817 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 20/38] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:50.830639 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d506fdad-7628-4bdf-863c-8dd6fdf2761c admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:50.838264 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.wsgi [None req-d506fdad-7628-4bdf-863c-8dd6fdf2761c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d506fdad-7628-4bdf-863c-8dd6fdf2761c admin admin] Request method failure captured: Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept: application/json Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept-Encoding: gzip, deflate Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Connection: keep-alive Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Content-Length: 0 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Host: 10.222.0.99 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-System-Scope: None Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: User-Agent: python-novaclient Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Auth-Token: gAAAAABjEnL-KtYFoBnbDGqw3v2r1bMjRCAiDDxpvez9RgDUQoFGW-pRltBupMEr1bqn7dewhHFytxMIWmp9MYclOc9_JhCjy8dQLHB5AqHBCfogXrf_JObJpgr-gZlqWsytswUauSr3FITv0hSiLh6yQOPpZjnXlJjtDhm91COIM-desqccHm8 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Id: None Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Name: None Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Identity-Status: Confirmed Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Is-Admin-Project: True Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Id: default Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Name: Default Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Name: admin Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Role: member,reader,admin Sep 02 21:17:50.841618 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Roles: member,reader,admin Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant: admin Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Name: admin Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User: admin Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Id: default Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Name: Default Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Name: admin Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: method: > Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: exception: Flavor 42 could not be found. Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: action_args: {'id': '42'} Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:50.843186 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:50.844089 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.845312 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d506fdad-7628-4bdf-863c-8dd6fdf2761c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:50.846459 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-d506fdad-7628-4bdf-863c-8dd6fdf2761c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.450886 Sep 02 21:17:50.846459 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 19/39] 10.222.0.99 () {60 vars in 1190 bytes} [Fri Sep 2 21:17:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:50.854152 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-fd960717-cb4a-4669-86db-8a1e864d5808 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:50.858402 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:50.878563 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-fd960717-cb4a-4669-86db-8a1e864d5808 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028996 Sep 02 21:17:50.879144 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 21/40] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:50.890543 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-7939eda6-7327-4117-a80b-0eb7a0fb7ef4 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:50.916284 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-7939eda6-7327-4117-a80b-0eb7a0fb7ef4 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029800 Sep 02 21:17:50.916862 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 20/41] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:50.929625 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f60a319f-bdc9-4543-9f39-1fc20abd14a6 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:50.935780 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.wsgi [None req-f60a319f-bdc9-4543-9f39-1fc20abd14a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f60a319f-bdc9-4543-9f39-1fc20abd14a6 admin admin] Request method failure captured: Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept: application/json Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept-Encoding: gzip, deflate Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Connection: keep-alive Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Content-Length: 0 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Host: 10.222.0.99 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-System-Scope: None Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: User-Agent: python-novaclient Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Auth-Token: gAAAAABjEnL-KtYFoBnbDGqw3v2r1bMjRCAiDDxpvez9RgDUQoFGW-pRltBupMEr1bqn7dewhHFytxMIWmp9MYclOc9_JhCjy8dQLHB5AqHBCfogXrf_JObJpgr-gZlqWsytswUauSr3FITv0hSiLh6yQOPpZjnXlJjtDhm91COIM-desqccHm8 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Id: None Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Name: None Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Identity-Status: Confirmed Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Is-Admin-Project: True Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Id: default Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Name: Default Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Name: admin Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Role: member,reader,admin Sep 02 21:17:50.939110 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Roles: member,reader,admin Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant: admin Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Name: admin Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User: admin Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Id: default Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Name: Default Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Name: admin Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: method: > Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: exception: Flavor 42 could not be found. Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: action_args: {'id': '42'} Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:50.952739 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:50.953641 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:50.954862 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f60a319f-bdc9-4543-9f39-1fc20abd14a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:50.955986 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-f60a319f-bdc9-4543-9f39-1fc20abd14a6 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014816 Sep 02 21:17:50.955986 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 22/42] 10.222.0.99 () {60 vars in 1190 bytes} [Fri Sep 2 21:17:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:51.963474 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-7939eda6-7327-4117-a80b-0eb7a0fb7ef4 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:51.964502 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-7939eda6-7327-4117-a80b-0eb7a0fb7ef4 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 02 21:17:51.964912 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 21/43] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:17:52.526258 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7e2d25fa-b118-48be-b4f0-d7f76753a7b3 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:52.532336 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.wsgi [None req-7e2d25fa-b118-48be-b4f0-d7f76753a7b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7e2d25fa-b118-48be-b4f0-d7f76753a7b3 admin admin] Request method failure captured: Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept: application/json Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept-Encoding: gzip, deflate Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Connection: keep-alive Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Content-Length: 0 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Host: 10.222.0.99 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-System-Scope: None Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: User-Agent: python-novaclient Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Auth-Token: gAAAAABjEnL_ZGIsBSF9saeqZQwXtaxWb_Jnz3DCjTqZWKT_QniAnN5a9PLLTxTOyMUSWjqEO4xEZXoJFywInXqVLVBeRQ7tFzwbgua2U7GqQybPpAiSJZifvKqglnTZ4WTAmkpEKfzyiXsNQWkkbGXoziiSFNiz-0JR3LrCWthqNdQ08YtWLa4 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Id: None Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Name: None Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Identity-Status: Confirmed Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Is-Admin-Project: True Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Id: default Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Name: Default Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Name: admin Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Role: member,reader,admin Sep 02 21:17:52.533914 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Roles: member,reader,admin Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant: admin Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Name: admin Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User: admin Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Id: default Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Name: Default Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Name: admin Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: method: > Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: exception: Flavor 84 could not be found. Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: action_args: {'id': '84'} Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:52.535471 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:52.537010 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.539383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7e2d25fa-b118-48be-b4f0-d7f76753a7b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:52.541891 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-7e2d25fa-b118-48be-b4f0-d7f76753a7b3 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.432420 Sep 02 21:17:52.541891 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 23/44] 10.222.0.99 () {60 vars in 1190 bytes} [Fri Sep 2 21:17:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:52.550229 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-6c828fc3-dba5-4895-96e9-6ad905415acf admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:52.566648 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-6c828fc3-dba5-4895-96e9-6ad905415acf admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022425 Sep 02 21:17:52.567229 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:52.578017 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-8db2fd5e-2188-4788-9295-1db3256c4f35 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:52.595155 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-8db2fd5e-2188-4788-9295-1db3256c4f35 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020584 Sep 02 21:17:52.595818 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:17:52.605732 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d17b2541-ac97-49e4-a063-4d30fa5f6447 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:52.611371 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.wsgi [None req-d17b2541-ac97-49e4-a063-4d30fa5f6447 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d17b2541-ac97-49e4-a063-4d30fa5f6447 admin admin] Request method failure captured: Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept: application/json Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept-Encoding: gzip, deflate Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Connection: keep-alive Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Content-Length: 0 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Host: 10.222.0.99 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-System-Scope: None Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: User-Agent: python-novaclient Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Auth-Token: gAAAAABjEnL_ZGIsBSF9saeqZQwXtaxWb_Jnz3DCjTqZWKT_QniAnN5a9PLLTxTOyMUSWjqEO4xEZXoJFywInXqVLVBeRQ7tFzwbgua2U7GqQybPpAiSJZifvKqglnTZ4WTAmkpEKfzyiXsNQWkkbGXoziiSFNiz-0JR3LrCWthqNdQ08YtWLa4 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Id: None Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Name: None Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Identity-Status: Confirmed Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Is-Admin-Project: True Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Id: default Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Name: Default Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Name: admin Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Role: member,reader,admin Sep 02 21:17:52.613214 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Roles: member,reader,admin Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant: admin Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Name: admin Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User: admin Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Id: default Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Name: Default Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Name: admin Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: method: > Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: exception: Flavor 84 could not be found. Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: action_args: {'id': '84'} Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:52.616704 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:52.618574 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:52.621116 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-d17b2541-ac97-49e4-a063-4d30fa5f6447 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:52.622686 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-d17b2541-ac97-49e4-a063-4d30fa5f6447 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012726 Sep 02 21:17:52.622686 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 23/47] 10.222.0.99 () {60 vars in 1190 bytes} [Fri Sep 2 21:17:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:53.642466 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-8db2fd5e-2188-4788-9295-1db3256c4f35 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:53.643852 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-8db2fd5e-2188-4788-9295-1db3256c4f35 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Sep 02 21:17:53.644355 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 25/48] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:54.211405 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-e80bc018-89dc-44fe-ad0c-6630e9d35868 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:54.217157 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.wsgi [None req-e80bc018-89dc-44fe-ad0c-6630e9d35868 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-e80bc018-89dc-44fe-ad0c-6630e9d35868 admin admin] Request method failure captured: Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept: application/json Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Accept-Encoding: gzip, deflate Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Connection: keep-alive Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Content-Length: 0 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Host: 10.222.0.99 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Openstack-System-Scope: None Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: User-Agent: python-novaclient Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Auth-Token: gAAAAABjEnMBgd-5-iUTjDKIN4edGr3foUAG8fBDF9r7kVdtJHUbItfF3Nhzdc3xK_OBKusLhcCZvFM-05Fci6L4uKI7x4ps_0bjx-vFCzBktQzgTLkDAGqDmPfj6vMKW_mUfYV-zSrkkWDCAp16puKeUb8kB4Q-xw50W44yGy7c8tbwTGS0sa8 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Id: None Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Domain-Name: None Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Identity-Status: Confirmed Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Is-Admin-Project: True Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Id: default Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Domain-Name: Default Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Project-Name: admin Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Role: member,reader,admin Sep 02 21:17:54.218698 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Roles: member,reader,admin Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant: admin Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-Tenant-Name: admin Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User: admin Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Id: default Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Domain-Name: Default Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: X-User-Name: admin Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: method: > Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: exception: Flavor 451 could not be found. Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: action_args: {'id': '451'} Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:54.221149 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:54.223280 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.225577 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-e80bc018-89dc-44fe-ad0c-6630e9d35868 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:54.227407 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-e80bc018-89dc-44fe-ad0c-6630e9d35868 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.436842 Sep 02 21:17:54.227407 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 24/49] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:17:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:54.230135 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-21acb791-c3c7-4259-a028-91f1bb865a53 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:54.246979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-21acb791-c3c7-4259-a028-91f1bb865a53 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020347 Sep 02 21:17:54.250081 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 26/50] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:54.258041 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:54.273885 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020004 Sep 02 21:17:54.274456 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 25/51] 10.222.0.99 () {60 vars in 1210 bytes} [Fri Sep 2 21:17:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:54.284362 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7eb674a2-0a0f-439c-8914-4d94d450ec12 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:54.290887 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.wsgi [None req-7eb674a2-0a0f-439c-8914-4d94d450ec12 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7eb674a2-0a0f-439c-8914-4d94d450ec12 admin admin] Request method failure captured: Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept: application/json Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Accept-Encoding: gzip, deflate Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Connection: keep-alive Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Content-Length: 0 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Host: 10.222.0.99 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-Api-Version: compute 2.92 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Openstack-System-Scope: None Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: User-Agent: python-novaclient Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Auth-Token: gAAAAABjEnMBgd-5-iUTjDKIN4edGr3foUAG8fBDF9r7kVdtJHUbItfF3Nhzdc3xK_OBKusLhcCZvFM-05Fci6L4uKI7x4ps_0bjx-vFCzBktQzgTLkDAGqDmPfj6vMKW_mUfYV-zSrkkWDCAp16puKeUb8kB4Q-xw50W44yGy7c8tbwTGS0sa8 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Id: None Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Domain-Name: None Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Identity-Status: Confirmed Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Is-Admin-Project: True Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Id: default Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Domain-Name: Default Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Project-Name: admin Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Role: member,reader,admin Sep 02 21:17:54.292436 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Roles: member,reader,admin Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8077ff7239e7425ab3b0ae8d4fecdd2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8077ff7239e7425ab3b0ae8d4fecdd2f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant: admin Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Id: 8077ff7239e7425ab3b0ae8d4fecdd2f Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-Tenant-Name: admin Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User: admin Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Id: default Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Domain-Name: Default Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Id: 65f8e87a284d46c3becdb8085954efaf Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: X-User-Name: admin Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: method: > Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: exception: Flavor 451 could not be found. Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: action_args: {'id': '451'} Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:17:54.294000 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:54.294979 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: ERROR nova.api.openstack.wsgi Sep 02 21:17:54.296287 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-7eb674a2-0a0f-439c-8914-4d94d450ec12 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:17:54.297496 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-7eb674a2-0a0f-439c-8914-4d94d450ec12 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013279 Sep 02 21:17:54.297496 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 27/52] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:17:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 02 21:17:55.313534 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:55.314597 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 02 21:17:55.315002 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 26/53] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:55.870217 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-631c1f00-0b35-4d66-90dc-8fa14a3c8e15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:55.989318 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-631c1f00-0b35-4d66-90dc-8fa14a3c8e15 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.536002 Sep 02 21:17:55.990020 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 28/54] 10.222.0.99 () {64 vars in 1235 bytes} [Fri Sep 2 21:17:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:17:57.031780 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:57.032724 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 02 21:17:57.033395 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 27/55] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:57.596216 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-df425152-3b8d-4a11-9368-ad8ed440f682 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:57.676691 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-df425152-3b8d-4a11-9368-ad8ed440f682 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.489953 Sep 02 21:17:57.677902 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 29/56] 10.222.0.99 () {64 vars in 1235 bytes} [Fri Sep 2 21:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:17:58.801305 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:58.802984 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 02 21:17:58.803553 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 28/57] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:59.494718 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-65997363-75a9-4dba-a065-589b4ba3a492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:17:59.586828 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-65997363-75a9-4dba-a065-589b4ba3a492 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.632728 Sep 02 21:17:59.587428 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 30/58] 10.222.0.99 () {64 vars in 1235 bytes} [Fri Sep 2 21:17:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:18:00.600963 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:00.602030 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 02 21:18:00.602451 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 29/59] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:18:01.161206 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-f127f772-ceb4-4d51-bab7-6393c3b4f0cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:18:01.243359 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-f127f772-ceb4-4d51-bab7-6393c3b4f0cd admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.494233 Sep 02 21:18:01.243931 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 31/60] 10.222.0.99 () {64 vars in 1235 bytes} [Fri Sep 2 21:18:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:18:02.250960 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:02.251988 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 02 21:18:02.252395 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 30/61] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:18:02.802456 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-b1937484-55c5-496d-a1e3-5067d02564ee admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:02.823819 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-b1937484-55c5-496d-a1e3-5067d02564ee admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.430638 Sep 02 21:18:02.824383 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 32/62] 10.222.0.99 () {60 vars in 1202 bytes} [Fri Sep 2 21:18:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:18:59.327708 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.332340 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-edbbc059-caf0-473f-8ce1-03137d56e2a8 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Sep 02 21:18:59.332340 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 31/63] 10.222.0.99 () {54 vars in 931 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:18:59.340801 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:59.756532 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-88485290-fd2d-43d9-b182-431387ee11d1 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.777463 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-88485290-fd2d-43d9-b182-431387ee11d1 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441071 Sep 02 21:18:59.778043 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 33/64] 10.222.0.99 () {60 vars in 1292 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:18:59.800012 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG dbcounter [-] [106235] Writing DB stats nova_api:SELECT=14 {{(pid=106235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:59.804383 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-257af051-585f-4d79-9119-13e4bb82691e admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.812120 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-257af051-585f-4d79-9119-13e4bb82691e admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013674 Sep 02 21:18:59.812724 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 32/65] 10.222.0.99 () {60 vars in 1283 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:18:59.824634 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-59b8cc67-4545-49da-b029-1c510fa254da admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.832966 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-59b8cc67-4545-49da-b029-1c510fa254da admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011928 Sep 02 21:18:59.833498 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 34/66] 10.222.0.99 () {60 vars in 1286 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:18:59.845241 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.853345 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011757 Sep 02 21:18:59.853898 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 33/67] 10.222.0.99 () {60 vars in 1286 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:18:59.870031 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-e38ea3dd-97a6-41ff-b591-3949a8bbf01a admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:18:59.883784 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-e38ea3dd-97a6-41ff-b591-3949a8bbf01a admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020537 Sep 02 21:18:59.884777 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 35/68] 10.222.0.99 () {60 vars in 1283 bytes} [Fri Sep 2 21:18:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:22:18.051603 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:18.052650 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 02 21:22:18.053035 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 34/69] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:18.202748 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=6 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:18.359027 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:18.362445 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:18.362923 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:18.363346 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:18.364058 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:18.364503 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:18.364923 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:18.400908 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-9c50d446-69ed-4720-a117-c5b8a6032d9d admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199697 Sep 02 21:22:18.401480 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 36/70] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:22:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:22:19.259763 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:19.260804 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 02 21:22:19.261204 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 35/71] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:19.454335 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:19.457732 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:19.458220 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:19.458656 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:19.459371 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:19.460325 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:19.460873 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:19.482205 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-c6d3ac16-f622-447f-bc09-a751b9a3ce12 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079252 Sep 02 21:22:19.482778 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 37/72] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:22:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:22:30.736136 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:30.737183 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 02 21:22:30.737583 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 36/73] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:30.884016 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_cell0:SELECT=4 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:30.884711 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_cell1:SELECT=4 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:30.885337 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG dbcounter [-] [106234] Writing DB stats nova_api:SELECT=8 {{(pid=106234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:30.936379 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:30.939849 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:30.940321 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:30.940781 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:30.941527 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:30.942049 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:30.942470 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:30.969677 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-29e82c33-39b8-4ef3-aa35-95f2e2d127fb admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.091033 Sep 02 21:22:30.970441 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 38/74] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:22:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:22:31.809816 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: DEBUG nova.api.openstack.wsgi [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] Calling method '>' {{(pid=106235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:31.810899 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: INFO nova.api.openstack.requestlog [None req-1e6d536c-5a58-4368-9a28-5f9c60bdd54a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Sep 02 21:22:31.811297 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: [pid: 106235|app: 0|req: 37/75] 10.222.0.99 () {56 vars in 1074 bytes} [Fri Sep 2 21:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:32.008864 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG nova.api.openstack.wsgi [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Calling method '>' {{(pid=106234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:32.012233 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:32.012734 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:32.013153 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:32.013896 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:32.014338 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:32.014754 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: DEBUG oslo_concurrency.lockutils [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:32.037951 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: INFO nova.api.openstack.requestlog [None req-c1644488-2027-4b62-ac33-fa3c3d557080 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085186 Sep 02 21:22:32.038517 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: [pid: 106234|app: 0|req: 39/76] 10.222.0.99 () {60 vars in 1193 bytes} [Fri Sep 2 21:22:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:32.658421 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: Fri Sep 2 21:23:32 2022 - graceful shutdown triggered... Sep 02 21:23:32.658539 dv-cinder-852211-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 21:23:32.659553 dv-cinder-852211-9-iscsi devstack@n-api.service[106234]: Gracefully killing worker 1 (pid: 106234)... Sep 02 21:23:32.660130 dv-cinder-852211-9-iscsi devstack@n-api.service[106235]: Gracefully killing worker 2 (pid: 106235)... Sep 02 21:23:33.660328 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: worker 1 buried after 1 seconds Sep 02 21:23:33.661065 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: worker 2 buried after 1 seconds Sep 02 21:23:33.661065 dv-cinder-852211-9-iscsi devstack@n-api.service[106233]: goodbye to uWSGI. Sep 02 21:23:33.662298 dv-cinder-852211-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 21:23:33.662867 dv-cinder-852211-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 21:23:33.666082 dv-cinder-852211-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 21:23:33.678573 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 21:23:33.680603 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 21:23:33 2022] *** Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: nodename: dv-cinder-852211-9-iscsi Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: machine: x86_64 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: clock source: unix Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: pcre jit disabled Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: detected number of CPU cores: 4 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: current working directory: / Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: detected binary path: /usr/bin/uwsgi-core Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: your processes number limit is 47680 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: your memory page size is 4096 bytes Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: detected max file descriptor number: 2048 Sep 02 21:23:33.680759 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: lock engine: pthread robust mutexes Sep 02 21:23:33.682323 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: thunder lock: enabled Sep 02 21:23:33.682323 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 21:23:33.682323 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 21:23:33.721944 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: Python main interpreter initialized at 0x563dc728e9c0 Sep 02 21:23:33.721944 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: python threads support enabled Sep 02 21:23:33.721944 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: your server socket listen backlog is limited to 100 connections Sep 02 21:23:33.721944 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: your mercy for graceful operations on workers is 90 seconds Sep 02 21:23:33.722372 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 21:23:33.722372 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: *** Operational MODE: preforking *** Sep 02 21:23:33.722690 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: *** uWSGI is running in multiple interpreter mode *** Sep 02 21:23:33.722690 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: spawned uWSGI master process (pid: 121260) Sep 02 21:23:33.722887 dv-cinder-852211-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 21:23:33.728135 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: spawned uWSGI worker 1 (pid: 121276, cores: 1) Sep 02 21:23:33.728135 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: spawned uWSGI worker 2 (pid: 121277, cores: 1) Sep 02 21:23:33.728135 dv-cinder-852211-9-iscsi devstack@n-api.service[121260]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 21:23:34.429109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:23:34.430577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:23:35.639158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:23:35.639158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: from cryptography.utils import int_from_bytes Sep 02 21:23:35.639947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:23:35.639947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: from cryptography.utils import int_from_bytes Sep 02 21:23:35.671355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:23:35.671355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: from cryptography.utils import int_from_bytes Sep 02 21:23:35.671355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:23:35.671355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: from cryptography.utils import int_from_bytes Sep 02 21:23:38.155390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:23:38.156009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:23:38.156346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:23:38.156579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:23:38.156841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:23:38.157248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.157587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.157947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.158280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.158636 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.158945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.159281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.159608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.159946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.160214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.160538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.161042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-9-iscsi {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.161386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.161736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.162063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.162397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.163127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.163127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.163334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.163856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.164328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.164822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.164958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.165477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.165724 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.166050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.166385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-9-iscsi {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.180751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.182055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.183599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.184764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.185423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.186662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.187021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.187021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.187275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.187602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.188099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.188579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.188904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.189364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.189872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.190196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.190940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.190940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.191400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.191603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.191729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.192054 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.192372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.192684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.193029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.193361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.193676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.194029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.194346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.194661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.194995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.195312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.195628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.195962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.196280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.196593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.196927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.197239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.197554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.197924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.198232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.198631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.199475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.199793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.200107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.200422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.200734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.201044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.201358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.201671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.202009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.202331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.202657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.202974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.203291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.203610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.203928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.204254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.204602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.204943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.205295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.205615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.205991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.206331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.206656 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.206977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.207299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.207631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.207950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.208267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.208583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.208904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.209231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.209569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.209944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.210267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.210596 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.210908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.211235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.211572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.212231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.212231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.212569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.213004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.213324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.213543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.213907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.214257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.214585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.214907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.215356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.215565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.215878 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.216215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.216537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.216869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.217189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.217503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.217858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.218352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.218676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.219085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.219369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.219658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.220002 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.220308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.220633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.220955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.221275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.221592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.226154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.227023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:23:38.227503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.227677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:23:38.227885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.227885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.228353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:23:38.228462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.228572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:23:38.228672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.228820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:23:38.228962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.229065 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.229160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.229252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.229351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.229445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.229532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.229532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.229690 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.230354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.230440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.230520 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.230599 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.230670 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.230740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.230821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.230901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.231004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.231574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.231683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.231777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.231777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.232020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-9-iscsi {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.232190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.232298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.232425 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.232528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.232615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.232693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.232777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.232899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.233009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.233098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.233579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.233687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.233953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.234064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.234158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.234158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.234672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.234798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.234900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.234900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.235050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.235232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.235417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235509 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.235600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.235822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.235997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.236082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.236164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.236246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.236366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.236468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.236581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.236673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.236763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-9-iscsi {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.236842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.236953 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.237061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.237215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.237377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.237537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.237692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.238048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.238159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.238387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.238492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.238690 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.238790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.239020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.239113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.239328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.239427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.239656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.239761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.239995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.240103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.240305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.240404 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.240634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.240750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.240961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.241055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.241272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.241386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.241599 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.241799 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.241942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.242079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.242261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.242356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.242582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.242697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.242886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.242996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.243145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.243240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.243476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.243592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.243807 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.243930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.244163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.244272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.244453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.244565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.244699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.244798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.244955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.245088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.245283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.245510 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.246294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.246396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.246686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.246874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.247038 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.247286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.247391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.247616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.247810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.247960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.248119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.248276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.248416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.248753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.248916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.248916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.249240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.249560 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.249831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.250007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.250167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.250314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.250478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.250642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.250822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.250972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.251118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.251261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.251416 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.251570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.251753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.251917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.252071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.252225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.252382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.252538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.252697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.252851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.252996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.253151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.253344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.253491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.255598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.255807 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.255968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.256128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.257136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.257136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.257136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.257619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.257619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.258021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.258410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.258506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.258778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.259094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.259410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.259724 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.260094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.260395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.262277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.262277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.262277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.262277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.262277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.263503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.263649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.263649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.264054 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.264201 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.264201 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.264467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.264613 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.264613 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.265264 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.265414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.265414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.265414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.265414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.265414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.266643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.266786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.266926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.267073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.267206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.267360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.267360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.268205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.268387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.268387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.268638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.268775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.268915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.269058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.269200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.269340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.269340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.269597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.269775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.269775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.270045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.270179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.270179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.270482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.270624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.270756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.270896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.270896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.271150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.271281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.271281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.271590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.271734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.271908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.272141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.272277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.272537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:23:38.272762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.272912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.273213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.273355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.273570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.273805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.273958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.274269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.274417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.274613 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.274966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.275109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.275500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.275627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.275883 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.276018 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.276205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.276456 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.276654 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.276902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.277129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.277306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.277530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.277851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.278169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.278313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.278512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.278677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.278823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.279135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.279279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.279460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.279657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.279799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.280113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.280248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.280447 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.280633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.280780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.281087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.281373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.281566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.281743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.281891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.282139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.282272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.282470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.282687 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.282831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.283097 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.283239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.283417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.283609 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.283781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.284067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.284218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.284452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.284586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.284759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.285089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.285232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.285387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.285761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.285993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.286129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.286323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.286497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.286632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.286940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.287104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.287301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.287443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.287574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.287860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.288129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.288380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.288525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.288663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.288869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.289011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.289195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.289370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.289508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.289847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.290163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.290304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.290478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.290672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.290890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.291096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.291229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.291409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.291714 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.291861 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.292071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.292900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.293546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.293699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.293865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.293865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.294131 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.294349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.294631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.294766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.294904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.295912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.296225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.296365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.296544 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.296784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.296975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.297178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.297310 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.297493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.297703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.297876 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.298143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.298277 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.298462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.298658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.298795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.299088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.299228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.299406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.299728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.299883 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.300072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.300219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.300390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.300552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.300734 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.301016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.301155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.301377 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.301509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.301869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.302885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.303067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.303309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.303443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.303678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.303991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.304307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.304489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.304715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.304916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.305087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.305218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.305469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.305689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.306936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.307170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.307303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.307481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.307901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.308592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.309937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.310929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.311074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.311284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.311425 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.311611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.311995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.312971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.313177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.313310 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.313510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.313837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.313983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.314184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.314325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.314492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.314800 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.314943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.315144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.315291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.315568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.315736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.315876 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.316241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.316439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.316581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.316797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.316976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.317109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.317380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.317523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.317699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.317881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.318997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.319241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.319385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.319635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.319929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.320890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.321075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.321229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.321462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.321596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.321957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.322198 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.322341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.322476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.322631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.322833 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.323240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.323240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.323512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.323720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.323900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.324469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.324616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.324756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.324756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.325246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.325397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.325537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.325881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.325881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.326155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.326506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.326506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.326506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.326901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.327922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.328063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.328255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.328542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.328686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.328891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.329023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.329186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.329445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.329587 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.329929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.335984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.336321 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.336845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.337910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.338907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.339057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.339213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.339366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.340961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341114 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341427 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341795 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.341961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.342115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.342294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.342450 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.342609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.342780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.343970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.344388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.344547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.344699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.344850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.345004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.345277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.345589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.345589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.345961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.346258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.346420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.346573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.346875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.347937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.348946 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349617 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.349959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350103 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350257 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.350912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.351919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.352201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.352360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.352512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.352710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.352940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.353230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.353398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.353553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.353706 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.353898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.354052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.354197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.354352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.354537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.354694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.355442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.355442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.356475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.356638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.356902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.357207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.357986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.358172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.358322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.358483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.358677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.358824 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.359015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.359172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.359376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.359788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.359941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360596 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.360908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361054 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.361884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.362932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363084 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.363955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.364984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.365138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.365332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.365657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.365847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.366891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.367043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.367043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.367500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.367667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.367817 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.368001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.368262 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.372698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.372923 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.373084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.373237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.373624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.373624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.380365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.380527 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.380678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.380835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.380835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.381144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.381302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.381495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.381722 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.381892 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.382999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.383163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.383331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.383494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.383765 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.383912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.384071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.384389 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.384566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.384731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.384877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385335 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.385987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.386176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.386924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.387244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.387497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.387677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.387939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.388100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.388262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.388435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.388693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.388693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.389784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390077 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.390821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391655 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.391966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392732 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.392910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.393141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.393295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.393295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.393569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.393861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394182 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.394949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.395795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.396977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.397179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.397534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.397812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.397993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.398266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.398420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.398564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.398740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.399003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.399162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.399162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.399481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.399682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.400158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.400325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.400325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.400673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.400839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.401013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.401246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.401404 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.401551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.401799 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.402046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.402350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403344 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.403829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.404844 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.405843 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.406078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.406345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.406511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.406685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.406842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.407001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.407205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.407382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.407762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408809 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.408962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.409123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.409292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.409571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.409753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.409944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410496 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.410798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.411864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.412327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.412491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.412643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.412793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.412943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.413108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.413260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.413671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.413916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.414100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.414372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.414542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.414718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.414872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.415865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.416025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.416229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.416520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.416680 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.416680 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.417022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.417176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.418841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.419165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.419339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.419507 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.419815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.420166 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.420345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.420501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.420663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.420823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.421634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.422396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.422562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.422714 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.422879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.423884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.424999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.425162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.425318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.425520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.425675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.425877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.426048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.426260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.426260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.426701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.426862 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.427830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.428000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.428376 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.428645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.428814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.428966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.429145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.429435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.429606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.430944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.431242 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.431403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.431403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.431713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.431907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.432842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.433580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.434409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.434593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.434876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435689 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.435842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.436969 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.437133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.437327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.437492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.437666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.437890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.438052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.438211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.438570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.438836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439157 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439354 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.439955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.440905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.441215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.441372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.441531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.441683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.441870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442031 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442354 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442548 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.442868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443338 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.443835 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.444802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.445754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.446137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.446301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.446301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.446651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.446825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447709 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.447898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.448069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.448229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.448387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.448859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.449180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.449464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.449961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.450133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.450405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.450565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.450725 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.450878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.451990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.452291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.452450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.452601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.452763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.452916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.453893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.454070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.454259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.454516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.454685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.454847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.455955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.456123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.456278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.456453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.456665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.456829 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.457796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.457980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.457980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.458281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.458441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.458597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.458954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.459155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.459424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.459627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.459798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.459798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.460250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.460436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.460717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.460879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461038 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.461868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.462954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.463901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.464062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.464291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.465069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.465275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.465549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.465855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.466999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.467160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.467331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.467492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.467492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.467934 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.468108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.468108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.468587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.468765 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.468765 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.469306 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.469596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.469596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.469921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.470073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.470073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.470525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.470715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.470997 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.471945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.472235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.472235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.472577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.472730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.472890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.473878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.474318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.474485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.474639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.474805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.474805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475431 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.475700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.476165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.476328 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.476590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.476804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.476804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.477593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.478308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.478469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.478632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.478785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.478946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.479299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.479466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.479741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.479741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.480908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.481767 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.481959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.482147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.482147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.482665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.482831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.482984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.483903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.484054 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.484219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.484386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.484386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.484932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485234 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.485908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.486222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.486385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.486553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.486718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.486718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487231 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.487912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.488349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.488518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.488518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.488518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.488966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.489126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.490558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.491966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.493136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.494472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.494472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.494472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.494472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.495070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.495253 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.495253 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.495606 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.496954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.497265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.497448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.497448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.497448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.497448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.498144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.498316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.498587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.498760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.498925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.499097 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.499256 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.499612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.499783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.499945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.500871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.501048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.501351 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.501351 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.501657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.501849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.502963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.503976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504236 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.504927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.505926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.507935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508028 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.508996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.509854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510131 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510222 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.510944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.511230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.511582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.511582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.512978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513621 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513726 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.513917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:23:38.514489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:23:38.514489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:23:38.563571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Registered counter for database nova_api Sep 02 21:23:38.572390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Registered counter for database nova_api Sep 02 21:23:38.584927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.592459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.593973 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.600691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.652618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.context [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee6d477e-b8ad-480a-9130-23ff2ba2795f(cell1) {{(pid=121276) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:23:38.656353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.657011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.658474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.659244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.659702 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.660444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.context [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee6d477e-b8ad-480a-9130-23ff2ba2795f(cell1) {{(pid=121277) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:23:38.661783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.663817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Registered counter for database nova_cell0 Sep 02 21:23:38.664477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.664968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.666695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.667684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.668189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.668271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Registered counter for database nova_cell1 Sep 02 21:23:38.670349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.674981 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Registered counter for database nova_cell0 Sep 02 21:23:38.675971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.676781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Registered counter for database nova_cell1 Sep 02 21:23:38.678356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.686475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.687779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.689789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.690578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.698488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.699458 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.857647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Registered counter for database nova_cell0 Sep 02 21:23:38.858120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Registered counter for database nova_cell0 Sep 02 21:23:38.865054 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.867157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:23:38.870245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:38.871983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:23:39.205701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:23:39.216044 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:23:39.225530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:23:39.233761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:23:39.595276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:23:39.601308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-5f8d7ff7-5dfe-42f3-928f-5f3f6f3170cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:23:39.607784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563dc728e9c0 pid: 121276 (default app) Sep 02 21:23:39.626001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:23:39.632159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-f6b0292b-9809-4533-8cca-61bce2c20e20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:23:39.637883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563dc728e9c0 pid: 121277 (default app) Sep 02 21:24:18.941439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:18.944163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:18.946206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:18.950465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.634363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.636120 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.637315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.638626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:20.643719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-24e43fd3-8de4-44a0-aa80-4f96fb59b357 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Action: 'create', calling method: .version_select at 0x7faac1b0c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-106986334"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:21.033506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3c994bae-d60f-4d40-a612-f90e12ff71da tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Action: 'create', calling method: .version_select at 0x7faac1b12550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1993628641", "metadata": {"Type": "work"}}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:23.867852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-24e43fd3-8de4-44a0-aa80-4f96fb59b357 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.944680 Sep 02 21:24:23.880320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 1/1] 10.222.0.99 () {60 vars in 1155 bytes} [Fri Sep 2 21:24:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4959 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 21:24:23.889182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de63c3ad-260e-4895-bab9-ca3c6f493af7 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac19f1160>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:23.977933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3c994bae-d60f-4d40-a612-f90e12ff71da tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.355293 Sep 02 21:24:23.978581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 1/2] 10.222.0.99 () {60 vars in 1156 bytes} [Fri Sep 2 21:24:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4358 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 21:24:23.995313 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eef8c034-582d-4b10-88d8-d2ba383e141f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac19e71f0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:24.142701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-de63c3ad-260e-4895-bab9-ca3c6f493af7 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 200 len: 344 microversion: 2.1 time: 0.260766 Sep 02 21:24:24.144413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 2/3] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:23 2022] GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 344 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:24.251173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eef8c034-582d-4b10-88d8-d2ba383e141f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.260262 Sep 02 21:24:24.252383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 2/4] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:23 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:25.162379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4d6fd552-f19d-43e8-929f-e52aa9b9bd01 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac19f18b0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:25.271519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2cfa1ca0-3d08-432f-8cf4-94e919cc2922 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac19e7550>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:25.577691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4d6fd552-f19d-43e8-929f-e52aa9b9bd01 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 200 len: 345 microversion: 2.1 time: 0.421679 Sep 02 21:24:25.587088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 3/5] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:25 2022] GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 345 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:25.593415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f661d70d-e0af-45db-bf17-3ac6ff49aca6 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Action: 'create', calling method: .version_select at 0x7faac19f1ee0>, body: {"snapshot": {"volume_id": "06ae421b-233f-4a2e-82bc-2d8b990ae709", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-657293895"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:25.658296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2cfa1ca0-3d08-432f-8cf4-94e919cc2922 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.393713 Sep 02 21:24:25.659067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 3/6] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:25 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:26.481831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f661d70d-e0af-45db-bf17-3ac6ff49aca6 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.892730 Sep 02 21:24:26.488357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 4/7] 10.222.0.99 () {60 vars in 1162 bytes} [Fri Sep 2 21:24:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:26.494569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb37f5c3-3b20-4405-bc79-bb52f2c6ee20 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac19e7940>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:26.605702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb37f5c3-3b20-4405-bc79-bb52f2c6ee20 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.115876 Sep 02 21:24:26.607284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 4/8] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:26 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:26.621286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-11375852-e70d-4d33-a157-6be24e97abde tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac19f1c10>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:26.675086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1d4bf7e0-de5c-4654-9363-d09a4f6f46cd tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac197a0d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.119411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1d4bf7e0-de5c-4654-9363-d09a4f6f46cd tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 354 microversion: 2.1 time: 1.449113 Sep 02 21:24:28.120414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 5/9] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:26 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 354 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:28.137864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1500aed3-1580-43af-8286-f6913918e72a tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac19e7b80>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.338656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-11375852-e70d-4d33-a157-6be24e97abde tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 1.724174 Sep 02 21:24:28.340210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 5/10] 10.222.0.99 () {58 vars in 1140 bytes} [Fri Sep 2 21:24:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:28.352962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da040376-d06e-406f-8f8a-3a431c9ff76a tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac1979af0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.478032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1500aed3-1580-43af-8286-f6913918e72a tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 354 microversion: 2.1 time: 0.344295 Sep 02 21:24:28.479880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da040376-d06e-406f-8f8a-3a431c9ff76a tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.130970 Sep 02 21:24:28.481247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 6/11] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:28 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:28.489776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 6/12] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:28 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 354 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:28.497664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ebc08560-07cc-4dbe-a42f-81d012b5d0f4 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac1979280>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.803720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ebc08560-07cc-4dbe-a42f-81d012b5d0f4 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 202 len: 0 microversion: 2.1 time: 0.309579 Sep 02 21:24:28.804452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 7/13] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:28 2022] DELETE /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:24:28.816971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bfd1c813-4a67-44f9-92f8-29fe4b693b02 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac19e73a0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.950018 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bfd1c813-4a67-44f9-92f8-29fe4b693b02 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.140645 Sep 02 21:24:28.951205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 7/14] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:28 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:29.497492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e71390f4-cc51-4eb0-b17c-f4ad32441b35 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac1979550>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:29.590048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e71390f4-cc51-4eb0-b17c-f4ad32441b35 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.099163 Sep 02 21:24:29.591670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 8/15] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:29 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:29.966513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b9b94117-f19a-456a-a522-4a5de2c9a018 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac1979d30>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:29.975406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-673100485", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "networks": [{"uuid": "df929528-1837-4b37-be64-e41cca36d9ea"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:30.047553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b9b94117-f19a-456a-a522-4a5de2c9a018 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.084902 Sep 02 21:24:30.048648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 9/16] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:29 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:30.136812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] validate_networks() for [('df929528-1837-4b37-be64-e41cca36d9ea', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:30.604971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ed16db69-0998-4e0d-bcd6-9f9574fddd65 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac197a040>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:30.663742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ed16db69-0998-4e0d-bcd6-9f9574fddd65 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.062626 Sep 02 21:24:30.667356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 10/17] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:30 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:31.063469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ddab85c7-8ccb-4339-ab7b-c1dced887f78 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac1979ee0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:31.172247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ddab85c7-8ccb-4339-ab7b-c1dced887f78 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.112764 Sep 02 21:24:31.173377 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 11/18] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:31 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:31.678261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e671137c-681a-48ab-9287-1bb678673989 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac1979940>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:31.750647 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e671137c-681a-48ab-9287-1bb678673989 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.077597 Sep 02 21:24:31.753319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 12/19] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:31 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:32.188464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1b50f0fc-a61b-48c2-aefe-e655ae5de578 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac197a4c0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:32.310325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1b50f0fc-a61b-48c2-aefe-e655ae5de578 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.126594 Sep 02 21:24:32.311507 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 13/20] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:32 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:32.680816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:32.681266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:32.681702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:32.682141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:32.683164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:32.732360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.732859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.733297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.739745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.741290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.742578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.764373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3f029c19-6373-4d45-9738-8d380a508f23 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac197a790>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:32.821374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Getting quotas for project 4b972cee2d99491096a0aba46391cec6. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:32.835133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Getting quotas for user 0b8cfb5d2a34451bb21d47bd5aae44f4 and project 4b972cee2d99491096a0aba46391cec6. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:32.844432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3f029c19-6373-4d45-9738-8d380a508f23 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.079782 Sep 02 21:24:32.845887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 14/21] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:32 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:32.885893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:32.890384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:33.231390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6a9b1e0-9b29-4c32-bd7f-dfe97a7157ef tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.453686 Sep 02 21:24:33.235896 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 8/22] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:24:33.248806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-19c7b778-7308-450f-b729-590294c923c9 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:33.250045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-19c7b778-7308-450f-b729-590294c923c9 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:33.356306 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-55c87c85-16c1-449d-acd3-57284aa709f2 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac1075d30>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:33.456378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-55c87c85-16c1-449d-acd3-57284aa709f2 tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.128505 Sep 02 21:24:33.458119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 9/23] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:33 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:33.519424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-19c7b778-7308-450f-b729-590294c923c9 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:33.558723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-19c7b778-7308-450f-b729-590294c923c9 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1214 microversion: 2.1 time: 0.308124 Sep 02 21:24:33.564676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 15/24] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:33 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:33.869554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-378e265a-25e1-49db-b399-5906e8c2408f tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac10904c0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.010777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-378e265a-25e1-49db-b399-5906e8c2408f tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 287 microversion: 2.1 time: 0.159401 Sep 02 21:24:34.017942 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 10/25] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:33 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:34.032744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f24a362d-0aeb-47f0-9680-7928dd0bbee0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: .version_select at 0x7faac193ee50>, body: {"keypair": {"name": "tempest-keypair-1416911051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJX9reqgIkkMbGax8pxoxiuPrS+5hFIZvroMooY6YPL9y4fZQqY6JnnnyBSiWEbxC0jrEIdd1fa69Wn8TzQWHXhQu7N3TmHx3yCQwPcPyBG/HcAHJ68wzLFnFoE/YVuOQ=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:34.034844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c1032dc3-9556-4b4d-8fae-9c978b72f768 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac1075d30>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.190891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f24a362d-0aeb-47f0-9680-7928dd0bbee0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for project d1e4957407e948fc909aadade7d19719. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:34.200310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f24a362d-0aeb-47f0-9680-7928dd0bbee0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for user 2ca47c37cd2d4999afa598cac6daa2e7 and project d1e4957407e948fc909aadade7d19719. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:34.339839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c1032dc3-9556-4b4d-8fae-9c978b72f768 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "DELETE /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 202 len: 0 microversion: 2.1 time: 0.317996 Sep 02 21:24:34.340792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 11/26] 10.222.0.99 () {58 vars in 1254 bytes} [Fri Sep 2 21:24:34 2022] DELETE /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:24:34.372819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7bff7d63-6f11-48de-9c9a-570b4638a5d0 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac1090790>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.433996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7bff7d63-6f11-48de-9c9a-570b4638a5d0 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 200 len: 286 microversion: 2.1 time: 0.083761 Sep 02 21:24:34.435786 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 12/27] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:34 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:34.510459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f24a362d-0aeb-47f0-9680-7928dd0bbee0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.653821 Sep 02 21:24:34.510459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 16/28] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:24:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:34.529301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-475d8b66-e88c-4565-8084-2f10664a53fb tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac1925ee0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.630840 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1598163759", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:34.647873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-475d8b66-e88c-4565-8084-2f10664a53fb tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 200 len: 353 microversion: 2.1 time: 0.137411 Sep 02 21:24:34.655238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 17/29] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:34 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:34.656776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c80afb2a-aff8-46d9-8dd8-f7a00873e559 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.659111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c80afb2a-aff8-46d9-8dd8-f7a00873e559 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:34.722518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] validate_networks() for [('fa27b18d-d540-49c4-ac05-71fff90bf993', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:34.730728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c80afb2a-aff8-46d9-8dd8-f7a00873e559 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:34.739481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c80afb2a-aff8-46d9-8dd8-f7a00873e559 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1214 microversion: 2.1 time: 0.088089 Sep 02 21:24:34.740856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 18/30] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:34 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:34.814869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f474e0cf-4664-4035-a1a5-435375328480 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: .version_select at 0x7faac18d79d0>, body: {"keypair": {"name": "tempest-keypair-1908970511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA3uWpXxPayQCBkAe+tlojq+Xa/MUwJZWwCBTbn8ETAGPtYBdvJIUr8qEp6tZHIf8haEAmLN8sWfp6TjlWYeFjzoIVZu0iBcyZ6VI3hHmxxNcETqM1R6YRw2JOmn72Zwg=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:34.844237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f474e0cf-4664-4035-a1a5-435375328480 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:34.851497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f474e0cf-4664-4035-a1a5-435375328480 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for user e4f87633619b42d989942e1d63d30fb0 and project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:35.020123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f474e0cf-4664-4035-a1a5-435375328480 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.277571 Sep 02 21:24:35.026705 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 19/31] 10.222.0.99 () {62 vars in 1200 bytes} [Fri Sep 2 21:24:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 21:24:35.458962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f102518c-5753-4d03-932a-0165fec26401 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac18e2e50>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:35.488321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:35.490600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:35.491297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:35.491983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:35.492818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:35.513218 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:35.515107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:35.515107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:35.516555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:35.517285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:35.518864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:35.597221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:35.619552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for user dc0bc75b6b3f4d1689bc1f7faaa2e5bc and project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:35.656125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:35.671936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:35.695604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-f102518c-5753-4d03-932a-0165fec26401 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] HTTP exception thrown: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f102518c-5753-4d03-932a-0165fec26401 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Request method failure captured: Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 HTTP/1.1 Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSCbXZBzcHaUCSCLjgCQlp8FZD5GZ0FXvLCZmqYtxCK81A21cRLG5LwxvCciDRPvYJ5YFAuwEoL_-VpWHJ-B0kVwk4b2E0xSA_z48TCNoRIl5A0vJ5uQD3TWDQiydPOqkbhWgCuRzINnyAgxZGY1ekNkRYODd5GY7msfMzVY7_7eVg Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:35.698335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dcbd2f3d11264077b82e63f3296f6d1f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: c5cab93814fd4d4b8c7ce6ca806eecce Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'cd55a748-732e-45f2-8d04-618b01439022'} Sep 02 21:24:35.699856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. (HTTP 404) (Request-ID: req-2f09bc8c-aa13-4fb3-8dea-b694ebb3c5c9) Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.700778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:35.702098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 02 21:24:35.703308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. Sep 02 21:24:35.704640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.706270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f102518c-5753-4d03-932a-0165fec26401 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Returning 404 to user: Snapshot cd55a748-732e-45f2-8d04-618b01439022 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:35.710841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f102518c-5753-4d03-932a-0165fec26401 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022" status: 404 len: 111 microversion: 2.1 time: 0.264487 Sep 02 21:24:35.719412 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 20/32] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:24:35 2022] GET /compute/v2.1/os-snapshots/cd55a748-732e-45f2-8d04-618b01439022 => generated 111 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:35.740100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5b658c25-017f-4eb7-9047-19a3f623be2f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Calling method '.version_select at 0x7faac18d7ca0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:35.820729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-5b658c25-017f-4eb7-9047-19a3f623be2f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] HTTP exception thrown: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5b658c25-017f-4eb7-9047-19a3f623be2f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Request method failure captured: Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 HTTP/1.1 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSD3erzDkdcdErseScpng_KPKnm0MEPQ-9tVlaCPC5E63vVEb7vEijvSzXun9_uGz7_zqWYYnRyM_xxthnQagiXfc4wMKuLG7ecf_2PbWOQpqvni5R5JKs93_mUjcEoJYjM_8ql9yYveFdyN7E60quYarGBpbHKg3D4xPJcgwNsI38 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: c62a4d1d2a8f41c8971f271ed5f38908 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesGetTestJSON-1070857464 Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:35.824219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c62a4d1d2a8f41c8971f271ed5f38908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c62a4d1d2a8f41c8971f271ed5f38908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c62a4d1d2a8f41c8971f271ed5f38908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c62a4d1d2a8f41c8971f271ed5f38908", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesGetTestJSON-1070857464 Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: c62a4d1d2a8f41c8971f271ed5f38908 Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesGetTestJSON-1070857464 Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesGetTestJSON-1070857464-project Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: b04de2af30e54ef385c8853e8bd47baf Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesGetTestJSON-1070857464-project Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '77f081cf-8985-45bb-b635-0901e3843ab1'} Sep 02 21:24:35.825324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. (HTTP 404) (Request-ID: req-78d5641b-7472-47f0-ae92-f8f8e9abeec7) Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.826154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:35.827057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:24:35.827933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. Sep 02 21:24:35.828791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:35.832940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5b658c25-017f-4eb7-9047-19a3f623be2f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] Returning 404 to user: Volume 77f081cf-8985-45bb-b635-0901e3843ab1 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:35.834128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5b658c25-017f-4eb7-9047-19a3f623be2f tempest-VolumesGetTestJSON-1070857464 tempest-VolumesGetTestJSON-1070857464-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1" status: 404 len: 109 microversion: 2.1 time: 0.108515 Sep 02 21:24:35.838322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 21/33] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:35 2022] GET /compute/v2.1/os-volumes/77f081cf-8985-45bb-b635-0901e3843ab1 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:35.852552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2eb64087-f31b-43bf-b088-7dcde63c62f3 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac18d7ee0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:35.917573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2c11b14-562d-4b24-85c6-b09ca6d1bbe3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.480423 Sep 02 21:24:35.918701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 13/34] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:24:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:24:35.943686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d488fd31-a10d-4605-bfce-3bf48d043c5f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:35.959900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d488fd31-a10d-4605-bfce-3bf48d043c5f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:36.223580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d488fd31-a10d-4605-bfce-3bf48d043c5f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:36.236075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2eb64087-f31b-43bf-b088-7dcde63c62f3 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 202 len: 0 microversion: 2.1 time: 0.396245 Sep 02 21:24:36.237033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 22/35] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:35 2022] DELETE /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:24:36.247189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05f463a8-e2c4-4620-ac0a-45e6a95b09cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:36.249481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-05f463a8-e2c4-4620-ac0a-45e6a95b09cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:36.284098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d488fd31-a10d-4605-bfce-3bf48d043c5f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1214 microversion: 2.1 time: 0.364732 Sep 02 21:24:36.284702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 14/36] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:35 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:36.290447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2e6160d7-8d03-453a-acbb-386a3ecb088d tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac10a71f0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:36.358922 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2e6160d7-8d03-453a-acbb-386a3ecb088d tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 200 len: 344 microversion: 2.1 time: 0.073007 Sep 02 21:24:36.360688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 15/37] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:36 2022] GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:36.464459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-05f463a8-e2c4-4620-ac0a-45e6a95b09cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:36.482637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05f463a8-e2c4-4620-ac0a-45e6a95b09cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1222 microversion: 2.1 time: 0.243735 Sep 02 21:24:36.483505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 23/38] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:36 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1222 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:36.607611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2070791667", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:36.755033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] validate_networks() for [('fa27b18d-d540-49c4-ac05-71fff90bf993', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:37.314167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:37.315641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:37.342990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:37.347464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:37.350077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:37.355549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:37.355549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:37.355549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:37.936764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:37.968854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b9009c8b-4f13-47b5-9ee5-7ddccc310ad5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1218 microversion: 2.1 time: 0.660995 Sep 02 21:24:37.969860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 24/39] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:37 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1218 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:37.985113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08d0c16f-9ff2-4cc6-adf5-c5edc52fe40e tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac17ccd30>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:38.062958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-08d0c16f-9ff2-4cc6-adf5-c5edc52fe40e tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] HTTP exception thrown: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08d0c16f-9ff2-4cc6-adf5-c5edc52fe40e tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Request method failure captured: Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 HTTP/1.1 Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSCbXZBzcHaUCSCLjgCQlp8FZD5GZ0FXvLCZmqYtxCK81A21cRLG5LwxvCciDRPvYJ5YFAuwEoL_-VpWHJ-B0kVwk4b2E0xSA_z48TCNoRIl5A0vJ5uQD3TWDQiydPOqkbhWgCuRzINnyAgxZGY1ekNkRYODd5GY7msfMzVY7_7eVg Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:38.066997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dcbd2f3d11264077b82e63f3296f6d1f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: c5cab93814fd4d4b8c7ce6ca806eecce Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '06ae421b-233f-4a2e-82bc-2d8b990ae709'} Sep 02 21:24:38.068517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. (HTTP 404) (Request-ID: req-f88cdba5-53b3-436c-ba8c-42e0d9049451) Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.069235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:38.070288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:24:38.071307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.072555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.073337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08d0c16f-9ff2-4cc6-adf5-c5edc52fe40e tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Returning 404 to user: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:38.074516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-08d0c16f-9ff2-4cc6-adf5-c5edc52fe40e tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 404 len: 109 microversion: 2.1 time: 0.103131 Sep 02 21:24:38.075560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 25/40] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:37 2022] GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:38.091862 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6fa8790-d8c0-4d32-9394-50fe3a4e4ef8 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac17ccb80>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:38.225768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-d6fa8790-d8c0-4d32-9394-50fe3a4e4ef8 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] HTTP exception thrown: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6fa8790-d8c0-4d32-9394-50fe3a4e4ef8 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Request method failure captured: Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 HTTP/1.1 Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSCbXZBzcHaUCSCLjgCQlp8FZD5GZ0FXvLCZmqYtxCK81A21cRLG5LwxvCciDRPvYJ5YFAuwEoL_-VpWHJ-B0kVwk4b2E0xSA_z48TCNoRIl5A0vJ5uQD3TWDQiydPOqkbhWgCuRzINnyAgxZGY1ekNkRYODd5GY7msfMzVY7_7eVg Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:38.228649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dcbd2f3d11264077b82e63f3296f6d1f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: c5cab93814fd4d4b8c7ce6ca806eecce Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '06ae421b-233f-4a2e-82bc-2d8b990ae709'} Sep 02 21:24:38.229770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. (HTTP 404) (Request-ID: req-821dd23c-51d0-4e2d-8b47-57d72f1693c7) Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.230430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:38.231362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:24:38.232297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.236378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.239838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6fa8790-d8c0-4d32-9394-50fe3a4e4ef8 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Returning 404 to user: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:38.240824 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d6fa8790-d8c0-4d32-9394-50fe3a4e4ef8 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 404 len: 109 microversion: 2.1 time: 0.155115 Sep 02 21:24:38.242033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 26/41] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:38 2022] DELETE /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:38.264920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5994e8aa-ca12-4880-a729-2d9070056b55 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Calling method '.version_select at 0x7faac18e9940>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:38.376906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-5994e8aa-ca12-4880-a729-2d9070056b55 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] HTTP exception thrown: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5994e8aa-ca12-4880-a729-2d9070056b55 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Request method failure captured: Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 HTTP/1.1 Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSCbXZBzcHaUCSCLjgCQlp8FZD5GZ0FXvLCZmqYtxCK81A21cRLG5LwxvCciDRPvYJ5YFAuwEoL_-VpWHJ-B0kVwk4b2E0xSA_z48TCNoRIl5A0vJ5uQD3TWDQiydPOqkbhWgCuRzINnyAgxZGY1ekNkRYODd5GY7msfMzVY7_7eVg Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:38.379357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dcbd2f3d11264077b82e63f3296f6d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dcbd2f3d11264077b82e63f3296f6d1f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: dcbd2f3d11264077b82e63f3296f6d1f Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954808814 Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: c5cab93814fd4d4b8c7ce6ca806eecce Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954808814-project Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '06ae421b-233f-4a2e-82bc-2d8b990ae709'} Sep 02 21:24:38.381641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. (HTTP 404) (Request-ID: req-b5262067-f1b1-4a32-8be0-a4e8f6c24822) Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.382405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:38.383652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:24:38.385485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. Sep 02 21:24:38.387776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:38.395570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5994e8aa-ca12-4880-a729-2d9070056b55 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] Returning 404 to user: Volume 06ae421b-233f-4a2e-82bc-2d8b990ae709 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:38.395570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5994e8aa-ca12-4880-a729-2d9070056b55 tempest-VolumesSnapshotsTestJSON-954808814 tempest-VolumesSnapshotsTestJSON-954808814-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709" status: 404 len: 109 microversion: 2.1 time: 0.141896 Sep 02 21:24:38.397405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 27/42] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:38 2022] GET /compute/v2.1/os-volumes/06ae421b-233f-4a2e-82bc-2d8b990ae709 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:24:38.515625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:38.516696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:38.517408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:38.518523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:38.519137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:38.538435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:38.540393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:38.541640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:38.543214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:38.546635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:38.547544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:38.642764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:38.655528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for user dc0bc75b6b3f4d1689bc1f7faaa2e5bc and project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:38.673144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:38.676765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:38.937845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-815c634c-d96e-4580-b614-788775b51903 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.334841 Sep 02 21:24:38.949986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 16/43] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:24:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:24:38.961581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e4519330-256b-45e4-92ed-4bbe13cd75ac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:38.962857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e4519330-256b-45e4-92ed-4bbe13cd75ac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:39.016635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:39.018061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:39.058734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:39.059276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:39.059713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:39.060464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:39.060904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:39.061453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:39.216970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4519330-256b-45e4-92ed-4bbe13cd75ac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:39.238941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e4519330-256b-45e4-92ed-4bbe13cd75ac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1222 microversion: 2.1 time: 0.279713 Sep 02 21:24:39.259858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 28/44] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:38 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:39.481540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:39.514765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-34bce19e-c6ba-4c98-8153-1a7653962ae4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1218 microversion: 2.1 time: 0.504368 Sep 02 21:24:39.525769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 17/45] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:39 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1218 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:40.271667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-35378902-e28e-42c7-ae2b-a38eacd8e52d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.272327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-35378902-e28e-42c7-ae2b-a38eacd8e52d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:40.396043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35378902-e28e-42c7-ae2b-a38eacd8e52d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:40.404546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-35378902-e28e-42c7-ae2b-a38eacd8e52d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1222 microversion: 2.1 time: 0.139150 Sep 02 21:24:40.424089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 29/46] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:40.541485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.542181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:40.567274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:40.569334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:40.570701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:40.577980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:40.579279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:40.579992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:40.869271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:40.882839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-10745148-653c-40d1-be83-b77e10daa3f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1210 microversion: 2.1 time: 0.346215 Sep 02 21:24:40.883442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 18/47] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1210 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:41.446301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-338998028", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8efadeb-2308-4c90-8862-ebd9e46f7697"}], "security_groups": [{"name": "tempest-securitygroup--1246716463"}], "key_name": "tempest-keypair-1908970511", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:41.507177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:41.508043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:41.530603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:41.531118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:41.531575 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:41.532301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:41.532767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:41.533201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:41.779812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:41.799055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-68da5f34-c8bb-4ee7-9700-aa22978edb33 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1218 microversion: 2.1 time: 0.295662 Sep 02 21:24:41.827003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 19/48] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:41 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:41.849588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-731590316", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbb739d3-1cc5-4982-9fe9-8871ccbc1cc6"}], "security_groups": [{"name": "tempest-securitygroup--566632115"}], "key_name": "tempest-keypair-1416911051", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:41.943625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] validate_networks() for [('b8efadeb-2308-4c90-8862-ebd9e46f7697', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:42.428084 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] validate_networks() for [('bbb739d3-1cc5-4982-9fe9-8871ccbc1cc6', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:43.766590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:43.767118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:43.767559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:43.768149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:43.768717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:43.787846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.799334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.799854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:43.803955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.804481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.804937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:43.866899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:43.868366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:43.869769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:43.871280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:43.872205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:43.874784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:43.888429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for user e4f87633619b42d989942e1d63d30fb0 and project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:43.900559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.901913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.904206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:43.916625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.918260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:43.918880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.920987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:43.933657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:43.960913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for project d1e4957407e948fc909aadade7d19719. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:43.964711 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for user 2ca47c37cd2d4999afa598cac6daa2e7 and project d1e4957407e948fc909aadade7d19719. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:43.982275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:43.986029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:44.211352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f1c3e54c-2e71-417d-85ff-fdd4b2ae66d9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.773266 Sep 02 21:24:44.227307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 30/49] 10.222.0.99 () {62 vars in 1188 bytes} [Fri Sep 2 21:24:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 21:24:44.313025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9ba53824-2982-46e5-a690-68555cf66fb7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.481863 Sep 02 21:24:44.318643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 20/50] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:24:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:24:44.341671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:44.345889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:44.392168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:44.394529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:44.397143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:44.398865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:44.400395 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:44.404016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:44.702963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:44.721238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e2366a72-d109-410e-b4f7-9745b77cc4e4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1272 microversion: 2.1 time: 0.393011 Sep 02 21:24:44.721238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 21/51] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:44 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1272 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:44.740414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:44.742416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:44.787288 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:44.798073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:44.798877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:44.799678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:44.800171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:44.821174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:44.883950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ea513b3-d282-4f8c-888f-a8c4634b3ce0 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Action: 'create', calling method: .version_select at 0x7faac16fa9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-622182869", "metadata": {"Type": "work"}}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ea513b3-d282-4f8c-888f-a8c4634b3ce0 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 121 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:44.902299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-622182869", "metadata": {"Type": "work"}}} Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:44.904595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-622182869', 'metadata': {'Type': 'work'}}}} Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi '#$%' Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:44.906025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:24:44.908355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:24:44.910588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:24:44.910588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:44.916980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ea513b3-d282-4f8c-888f-a8c4634b3ce0 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:44.919539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9ea513b3-d282-4f8c-888f-a8c4634b3ce0 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.689732 Sep 02 21:24:44.920293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 31/52] 10.222.0.99 () {60 vars in 1156 bytes} [Fri Sep 2 21:24:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 692 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:24:44.934978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:44.938362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:45.091822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.114962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-57da3802-f24e-44c7-a729-62201f1d1615 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1280 microversion: 2.1 time: 0.394660 Sep 02 21:24:45.114962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 22/53] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:44 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1280 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:45.157196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4305203d-16fc-4a13-a7a4-50645b07dcaa tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:45.158188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4305203d-16fc-4a13-a7a4-50645b07dcaa tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:45.182483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.206190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.216093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.218993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7760d74a-7764-451d-88da-97c87ffa4512 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1281 microversion: 2.20 time: 0.293479 Sep 02 21:24:45.242342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 32/54] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:44 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:45.256999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b2df128-9814-4a81-8766-2b28f3b54959 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Action: 'create', calling method: .version_select at 0x7faac16fa9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590945326", "metadata": {"Type": "work"}}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b2df128-9814-4a81-8766-2b28f3b54959 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 120 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:45.281746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590945326", "metadata": {"Type": "work"}}} Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:45.283799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1590945326', 'metadata': {'Type': 'work'}}}} Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi '0' Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:45.284441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:24:45.285608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:24:45.286890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:24:45.286890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.289266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b2df128-9814-4a81-8766-2b28f3b54959 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:45.291456 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b2df128-9814-4a81-8766-2b28f3b54959 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.054995 Sep 02 21:24:45.298697 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 33/55] 10.222.0.99 () {60 vars in 1156 bytes} [Fri Sep 2 21:24:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:24:45.308263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b126444-4fc9-4f4d-a9a8-1536a9e47b6e tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Action: 'create', calling method: .version_select at 0x7faac0eb6940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1123319126", "metadata": {"Type": "work"}}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b126444-4fc9-4f4d-a9a8-1536a9e47b6e tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 119 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:45.347062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1123319126", "metadata": {"Type": "work"}}} Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:45.348276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1123319126', 'metadata': {'Type': 'work'}}}} Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi '' Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:45.348907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:24:45.350864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:24:45.355834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:24:45.355834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.355834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b126444-4fc9-4f4d-a9a8-1536a9e47b6e tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:45.355834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b126444-4fc9-4f4d-a9a8-1536a9e47b6e tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.053133 Sep 02 21:24:45.367327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 34/56] 10.222.0.99 () {60 vars in 1156 bytes} [Fri Sep 2 21:24:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:24:45.379060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f32c72f2-e101-4c3f-bc9b-1fc3386ad8fa tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Calling method '.version_select at 0x7faac16fa700>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:45.398611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4305203d-16fc-4a13-a7a4-50645b07dcaa tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.411156 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4305203d-16fc-4a13-a7a4-50645b07dcaa tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1237 microversion: 2.1 time: 0.279434 Sep 02 21:24:45.414009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 23/57] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:45 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1237 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:45.623085 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-f32c72f2-e101-4c3f-bc9b-1fc3386ad8fa tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] HTTP exception thrown: Volume tempest-invalid-1931045890 could not be found. Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f32c72f2-e101-4c3f-bc9b-1fc3386ad8fa tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1931045890 HTTP/1.1 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:24:45.625208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Volume tempest-invalid-1931045890 could not be found. Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'tempest-invalid-1931045890'} Sep 02 21:24:45.626514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1931045890 could not be found. (HTTP 404) (Request-ID: req-664adfac-eb3d-4daf-8e15-062e9ffb6b65) Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.627169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:45.628138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1931045890 could not be found. Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:45.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1931045890 could not be found. Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1931045890 could not be found. Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f32c72f2-e101-4c3f-bc9b-1fc3386ad8fa tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 404 to user: Volume tempest-invalid-1931045890 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f32c72f2-e101-4c3f-bc9b-1fc3386ad8fa tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1931045890" status: 404 len: 99 microversion: 2.1 time: 0.254843 Sep 02 21:24:45.635906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 35/58] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:24:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1931045890 => generated 99 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 02 21:24:45.654674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6bead2b8-0180-48dc-9ebf-ee20005df978 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010672 Sep 02 21:24:45.655984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 24/59] 10.222.0.99 () {58 vars in 1140 bytes} [Fri Sep 2 21:24:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 21:24:45.703684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-41303735-f9e6-412d-aea8-2c9ba70e2c25 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.036500 Sep 02 21:24:45.706029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 36/60] 10.222.0.99 () {58 vars in 1137 bytes} [Fri Sep 2 21:24:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 21:24:45.722901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07e5b9f6-d386-48cd-83ac-32bf5ca0e28f tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Calling method '.version_select at 0x7faac0f7fee0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:45.749806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:45.749806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:45.764235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:45.765341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:45.767434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:45.768797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:45.769630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:45.770384 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:45.910257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-07e5b9f6-d386-48cd-83ac-32bf5ca0e28f tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] HTTP exception thrown: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07e5b9f6-d386-48cd-83ac-32bf5ca0e28f tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/os-volumes/9b01e0bd-46b5-42f8-8752-a52b2af76558 HTTP/1.1 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:24:45.953920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '9b01e0bd-46b5-42f8-8752-a52b2af76558'} Sep 02 21:24:45.955071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. (HTTP 404) (Request-ID: req-1042e07a-d9ef-4220-a891-494f58cfd4d2) Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.955705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:24:45.956629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:24:45.957525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07e5b9f6-d386-48cd-83ac-32bf5ca0e28f tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 404 to user: Volume 9b01e0bd-46b5-42f8-8752-a52b2af76558 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-07e5b9f6-d386-48cd-83ac-32bf5ca0e28f tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/9b01e0bd-46b5-42f8-8752-a52b2af76558" status: 404 len: 109 microversion: 2.1 time: 0.240533 Sep 02 21:24:45.961737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 25/61] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:45 2022] DELETE /compute/v2.1/os-volumes/9b01e0bd-46b5-42f8-8752-a52b2af76558 => generated 109 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:45.978669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e83f98c2-a6f3-4baf-8c14-6e2d8bedef16 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Calling method '.version_select at 0x7faac0f7faf0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:46.131692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-e83f98c2-a6f3-4baf-8c14-6e2d8bedef16 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] HTTP exception thrown: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e83f98c2-a6f3-4baf-8c14-6e2d8bedef16 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Request method failure captured: Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/os-volumes/5be6c81d-d1d6-4074-918c-31734596f1c3 HTTP/1.1 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSZoYLIV68hMnw5fGTjgcfDJxk1MKM9xyPNPZYaY-bR7akZ5PIakPM-Rxc2EzXJ5do9eKgCP59aBOcfsVFoIRO6-wVth6AKHUOC0GPx-i_TUPfX2BJlwfojiZLlODhFx6ZJBj7hFG-F7S4MoC4XW815LuX7uxrN3Ii0W-IrL1APlrc Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:24:46.133766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1c985b90cb984d80b80295234a9cd915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1c985b90cb984d80b80295234a9cd915", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 1c985b90cb984d80b80295234a9cd915 Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesNegativeTest-2106369697 Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: bb85ca23ca83431bb495ffc779968bb8 Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesNegativeTest-2106369697-project Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '5be6c81d-d1d6-4074-918c-31734596f1c3'} Sep 02 21:24:46.134990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. (HTTP 404) (Request-ID: req-c6a44d70-8e59-475a-ba68-6bc910a185be) Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:46.135637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:46.144930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:24:46.152619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e83f98c2-a6f3-4baf-8c14-6e2d8bedef16 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] Returning 404 to user: Volume 5be6c81d-d1d6-4074-918c-31734596f1c3 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e83f98c2-a6f3-4baf-8c14-6e2d8bedef16 tempest-VolumesNegativeTest-2106369697 tempest-VolumesNegativeTest-2106369697-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/5be6c81d-d1d6-4074-918c-31734596f1c3" status: 404 len: 109 microversion: 2.1 time: 0.170099 Sep 02 21:24:46.153564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 26/62] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:45 2022] GET /compute/v2.1/os-volumes/5be6c81d-d1d6-4074-918c-31734596f1c3 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:46.155864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.163542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:46.163813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:46.174799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-72296d4f-afb7-455e-b5f5-d64c9a27c804 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1272 microversion: 2.1 time: 0.432479 Sep 02 21:24:46.179160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 37/63] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:45 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:46.187049 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:46.188012 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:46.188729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:46.189695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:46.193938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:46.194857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:46.279337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:46.283886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:46.370651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.383589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fb487b69-513a-4ef6-ac9d-a3adcce7156e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1280 microversion: 2.1 time: 0.227296 Sep 02 21:24:46.388665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 27/64] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:46 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:46.466068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df33afe5-23b4-4448-bdc4-dee7d37407e6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:46.466957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df33afe5-23b4-4448-bdc4-dee7d37407e6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:46.522932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.537895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.540254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.546865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fa7b438e-37ba-42b4-b06f-e4ea48123572 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1281 microversion: 2.20 time: 0.279250 Sep 02 21:24:46.548789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 38/65] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:46 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:46.614650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df33afe5-23b4-4448-bdc4-dee7d37407e6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:46.632374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df33afe5-23b4-4448-bdc4-dee7d37407e6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1237 microversion: 2.1 time: 0.174723 Sep 02 21:24:46.633000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 28/66] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:46 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1237 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:47.215608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:47.216241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:47.252733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.260195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.260903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.261847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.270394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.271068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.457924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:47.457924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:47.469862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.470350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.477579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.478249 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.488209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.489479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.299253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.317001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ad1a683a-27ec-466f-8b4a-34f6e70ed833 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1280 microversion: 2.1 time: 0.883699 Sep 02 21:24:48.338112 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 29/67] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:47 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1280 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:48.347772 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:48.348898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:48.358052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.359935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.362597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.366048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.367001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.367622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.780583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.795063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.797102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.797777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.799248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1f35f822-b60a-4d74-8763-b7b59608a1b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1277 microversion: 2.20 time: 0.473907 Sep 02 21:24:48.813838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 30/68] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:48 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1277 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:48.814130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d1755969-b447-402a-84f4-26ba09dbfe72 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 1.611815 Sep 02 21:24:48.814130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 39/69] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:47 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:48.822838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:48.854858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:48.866248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.866861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.867322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.868088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.868557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.868992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.107895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:49.133008 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0703d1f3-48ee-4ac7-85c5-1809a264c858 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1289 microversion: 2.1 time: 0.313290 Sep 02 21:24:49.161586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 31/70] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:48 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1289 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:49.355729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:49.355729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:49.370073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.370579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.371243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.372140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.373063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.373675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.784152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:49.797122 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3683aae2-f8a2-4e45-b3fc-b8244890e885 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.449640 Sep 02 21:24:49.801267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 40/71] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:49 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:49.831958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:49.833376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:49.839456 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:49.843320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:49.857576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.858881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.859561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.861166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.862328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.863102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.863877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.881784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.881999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.882082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.882082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.882082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.236632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:50.250337 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:50.251793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:50.255684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4878d399-288c-483d-a930-2ecdae5e1db6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1333 microversion: 2.20 time: 0.428164 Sep 02 21:24:50.269914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 32/72] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:49 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1333 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:50.280680 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:50.281440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:50.298561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:50.311319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.311829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.312307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.320272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.322338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.331182 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.399350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:50.416058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f72ef74-db4c-471c-8d38-c32444e1bae5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.580560 Sep 02 21:24:50.417012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 41/73] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:49 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:50.822782 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:50.823673 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:50.855970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.860896 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:50.861968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.863688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.867068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.869371 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.870427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.880214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b2cfb144-de42-490d-9d41-e977ce3ca6f2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1289 microversion: 2.1 time: 0.618283 Sep 02 21:24:50.892816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 33/74] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:50 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1289 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:51.298640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:51.299399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:51.311918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.316593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:51.322769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.323805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.327615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:51.332289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.550606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:51.571278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6d807324-735a-4718-96d8-c31665710e0b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.754208 Sep 02 21:24:51.594413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 42/75] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:50 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:51.625153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:51.625987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:51.644958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.645700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:51.646438 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.647382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.654583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:51.654583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.894561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:51.929739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:51.939787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:51.949139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8761d1c3-0bc6-45ae-9dd6-629c5cb903fd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1339 microversion: 2.20 time: 0.664960 Sep 02 21:24:51.949891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 34/76] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:51 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1339 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:51.964650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:51.969844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:51.990489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.996589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:51.998176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.998793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:51.999605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:52.000279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:52.258845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:52.271891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4c51c95-95c9-4a1c-b074-bbaa5b7068c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1295 microversion: 2.1 time: 0.317407 Sep 02 21:24:52.289122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 35/77] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:51 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1295 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:52.610469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:52.611587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:52.645664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:52.649137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:52.650924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:52.652560 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:52.653602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:52.654508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:52.729670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:52.748917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e11bc4f1-50a4-4d45-90f8-80c3247497f5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 1.152704 Sep 02 21:24:52.749818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 43/78] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:51 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:53.003236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:53.004213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:53.018391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:53.019910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:53.023274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:53.024350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:53.028295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:53.029202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:53.499424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:53.543162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:53.546722 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:53.550397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4afc01ef-214d-4a92-8342-1342864a74ea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1339 microversion: 2.20 time: 0.552854 Sep 02 21:24:53.551989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 44/79] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:52 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1339 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:53.560092 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:53.560988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:53.584343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:53.587648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:53.588366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:53.601424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:53.602222 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:53.603041 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:53.849581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:53.940472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:53.973033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:54.028457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9551171-0230-47e8-ab72-575dc110bdda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 1.425236 Sep 02 21:24:54.049851 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 36/80] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:52 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:54.093018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:54.110818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-32a8adbe-641d-4bf3-9373-93919df98ada tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1295 microversion: 2.1 time: 0.554287 Sep 02 21:24:54.113892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 45/81] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:53 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1295 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:54.162058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:54.164074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:54.223036 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.227332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.227332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.236458 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.240536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.242297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.525369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd02634-3dc0-41cf-996f-9f0d3962e44f", "tag": "57567b04-131e-41d4-9c37-96358cb8fe16"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:54.559494 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.559893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.560389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.621212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Creating event network-changed:57567b04-131e-41d4-9c37-96358cb8fe16 for instance ebd02634-3dc0-41cf-996f-9f0d3962e44f on hv-cinder-85221 Sep 02 21:24:54.624718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 21:24:54.625512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b42cc78d-7300-4ef8-a28a-75120acadbbb req-aa65e10d-341c-4627-a8a5-9c5c2fb36211 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 21:24:54.626968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.633530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.633956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.634778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.635255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.635700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.658753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.compute.rpcapi [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 21:24:54.659921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] Releasing lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 21:24:54.694789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-47945936-e0c2-45a3-b25a-0b263236e79c None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576889 Sep 02 21:24:54.699011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 46/82] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:54.716744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:54.719087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:54.735383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.744879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.746390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.748677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.751106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.754644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.911825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:54.926880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0100dc41-f26d-43f8-bbad-c639b6286560 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.886667 Sep 02 21:24:54.927493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 37/83] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:54 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:54.990815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.021191 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.029034 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.033094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ba6d066c-712e-4542-8be5-8cc9bfb6efd0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1339 microversion: 2.20 time: 0.331439 Sep 02 21:24:55.039920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 47/84] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:54 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1339 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:55.074405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:55.076323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:55.091151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.091666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.095151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:55.096296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.098371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.104956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:55.110885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:55.173588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:55.175805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:55.187526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.188074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.188528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:55.194254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.194254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.194254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:55.408787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.438261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4d8e9eb9-c584-4148-aefa-0e4169576a65 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1295 microversion: 2.1 time: 0.276272 Sep 02 21:24:55.439502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 48/85] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:55 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:55.802099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.811533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f642fb4e-ff72-4338-bbe5-4777922d2f9e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.744531 Sep 02 21:24:55.812659 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 38/86] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:55 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:55.952482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:55.953113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:55.969760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.975076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.975540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:55.977075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:55.977854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:55.978366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.350100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:56.350100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:56.350100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.350100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.352858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.352858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.352858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.352858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.353308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.353308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b0819dd-df3a-4e49-bb83-d9dee6be3e4b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.365424 Sep 02 21:24:56.353308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 49/87] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:55 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:56.354409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.354409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.354593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.354593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6d469418-6f24-4d84-a840-85baafeda5dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.285231 Sep 02 21:24:56.354593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 39/88] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:56 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:24:56.467138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:56.468218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:56.475005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.475798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.476436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.478127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.478127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.478458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.530144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=28 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:56.550368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.559385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6c16b126-9d8b-4cd4-8e78-6bb9a2dfc273 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1295 microversion: 2.1 time: 0.096010 Sep 02 21:24:56.559983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 50/89] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:56 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:56.858871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa471e49-7a31-4503-bb55-d08d1eaccc88", "tag": "da88f783-6182-4201-aeab-8bef35459820"}, {"name": "network-changed", "server_uuid": "6bf9bb41-be89-4802-ba81-6eb3fa5ebb68", "tag": "97b914ee-5150-4e32-adc8-6632678fd9f8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:56.863128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:56.864364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:56.870388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:56.873419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=30 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:56.879194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.880064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.881082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.884703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.885501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.886251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.887875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.888872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.889822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.902731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Creating event network-changed:da88f783-6182-4201-aeab-8bef35459820 for instance aa471e49-7a31-4503-bb55-d08d1eaccc88 on hv-cinder-85221 Sep 02 21:24:56.903254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] Creating event network-changed:97b914ee-5150-4e32-adc8-6632678fd9f8 for instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 on hv-cinder-85221 Sep 02 21:24:56.909832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-ae46948b-a62e-48a6-982a-741585b328fd req-68150828-bede-4477-9bae-1d32c3d43624 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057407 Sep 02 21:24:56.910445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 51/90] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:57.082573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.092727 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-531cffa4-8094-4024-896e-64779f3afba5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.244069 Sep 02 21:24:57.093318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 40/91] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:56 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:57.384421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:57.397948 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:57.401129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:57.402284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:57.433895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.434863 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.435494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.436669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.437512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.438122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.450112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.451122 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.453949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.459811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.460842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.461914 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.822556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.824269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.834221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da8bbeef-4499-4663-9e03-066f6412ddd1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.460065 Sep 02 21:24:57.835143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 52/92] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:57 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:57.840454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.843728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.845905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-94c3a6dd-878e-48ba-89a0-efbd46749d6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.459474 Sep 02 21:24:57.847557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 41/93] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:57 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:24:57.857866 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:57.858498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:57.865860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.866592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.867090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.867834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.868339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.868775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.014027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:58.021799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2992d827-87b0-46b2-a1e1-0b4cfbf0958a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.184825 Sep 02 21:24:58.022394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 53/94] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:57 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:58.135760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:58.137327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:58.149385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.150339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.151399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.152681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.153573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.154473 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.321693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:58.333473 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f636a6eb-446e-4cc3-b80e-d5fa2a5429f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.204307 Sep 02 21:24:58.334450 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 42/95] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:58 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:58.863722 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:58.864955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:58.877281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.878209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.879958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:58.880497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.880598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:58.880684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.881060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.883658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.891833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:58.895703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.896577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.897448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.899498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.900436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.901230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.110908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.122083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6d5630e4-f582-41f3-a1a5-7c0f4b7d8a01 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.265762 Sep 02 21:24:59.122799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 54/96] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:58 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:59.138188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.145755 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.145755 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.147885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e327d580-ab46-4336-bb05-c89dc5e121ba tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.277553 Sep 02 21:24:59.154961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:59.155627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:59.161993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.162595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 43/97] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:58 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:59.162729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.163041 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.164663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.165492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.166276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.361198 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:59.362518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:59.372953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.373872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.374947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.376230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.376995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.378009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.398603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.420747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ea7bd4e4-98f9-4d07-8691-9f9e8d8f43b0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.277709 Sep 02 21:24:59.422038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 55/98] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:59 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:59.626387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.642247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-afb9437a-f21b-48f4-8214-e035bb228a9c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.288282 Sep 02 21:24:59.643293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 44/99] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:59 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:00.160817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:00.162239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:00.192142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.196731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.197578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.198815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.199093 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:00.199608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.200414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:00.208144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.228598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.231824 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.236918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.239097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.240567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.243933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.232375 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:01.244822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-21b02ec7-5a1c-479b-b367-e35f7b5a4e4e tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 1.090701 Sep 02 21:25:01.258238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 56/100] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:00 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:01.271928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:01.279419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:01.316487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.319706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.323423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.327077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.331202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.332584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.377323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:01.448127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:01.450569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:01.451244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e7686a09-3341-4c03-b3a1-c6d6e9bd3594 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 1.262105 Sep 02 21:25:01.451901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 45/101] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:00 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:01.487941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:01.491024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:01.510959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.512334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.513379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.515020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.516020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.517108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.469451 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:02.495699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-45607791-ed09-49e0-a7c3-d5dd003ef867 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 1.235597 Sep 02 21:25:02.496651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 57/102] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:01 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:02.518743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:02.521471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:02.531731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.532384 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.533154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.538992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.540255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.542319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.639669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:02.659409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-edc26c88-e596-40de-83c7-5ed491882beb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 1.175386 Sep 02 21:25:02.660696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 46/103] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:01 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:02.685759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:02.686868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:02.694916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.699542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.700180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.701107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.702491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.703745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.092668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.121156 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ad9da1e0-e7cd-4a9a-b55e-3c8097474e4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.621211 Sep 02 21:25:03.137841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 58/104] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:02 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:03.183842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.194524 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.197421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.247592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-04f55738-51f2-4a75-b321-419854e2da3d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.584161 Sep 02 21:25:03.251854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 47/105] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:02 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:03.526142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:03.527453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:03.542596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.545012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.546138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.551391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.551391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.551391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.691296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:03.691296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:03.701491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.743388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.743388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.743388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.743388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.744487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.115880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.131328 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e16065b1-33a1-4c00-8849-7112380535a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.607537 Sep 02 21:25:04.140428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 59/106] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:03 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:04.175118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.189226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:04.192386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:04.203887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-edfa9b50-6d97-4cda-8140-cef1362a4503 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.519281 Sep 02 21:25:04.207759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.214057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 48/107] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:03 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:04.214252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.214252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.214252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.214252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.214529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.278004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:04.278707 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:04.295476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.295476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.296452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.301546 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.302255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.302849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.733292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:04.736973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.751911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.752712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-34a1a4dc-59e7-4dae-8e3d-203703807e24 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.576015 Sep 02 21:25:04.753477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 60/108] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:04 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:04.769670 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.771146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.772312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f1f1b77d-955f-4c8e-a383-835960c2157f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.499738 Sep 02 21:25:04.773250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 49/109] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:04 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:05.169132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:05.172121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:05.190046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.190046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.190046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.190294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.191181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.192155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.501216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:05.523506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.525360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.526532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.555183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] Creating event network-changed:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:25:05.568674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-86e42d14-4943-494a-bba5-92dab3992c05 req-f64eab82-dfc5-471b-a88e-c408bc6ac076 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574409 Sep 02 21:25:05.571440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 61/110] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:05.585919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:05.588580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:05.601472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.603567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.606819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.608508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.618682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.618682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.735342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:05.748052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2b712f9d-86d5-446c-a575-cb7dfa8f7b27 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.591752 Sep 02 21:25:05.754696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 50/111] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:05 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:05.794062 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:05.797707 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:05.804338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.805858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.806626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.807669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.808302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.809075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.819229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:05.834199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef430cf7-ac91-4b9c-9dce-ecd97f9086f0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.260060 Sep 02 21:25:05.835490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 62/112] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:05 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:05.873891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:05.875534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:05.885462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.889840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.889840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.889840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.890265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.891848 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.219542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.220766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.231012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.233402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.234857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-086cd83c-dd16-4ff2-9238-e4ba864e1d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.383042 Sep 02 21:25:06.235954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 63/113] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:05 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:06.243169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7c927fc9-f2df-408f-8281-919796ce74b6 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.460662 Sep 02 21:25:06.260020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 51/114] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:05 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:06.775155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:06.775396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:06.786118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.787108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.787558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.788425 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.788895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.790134 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.876173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:06.877144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:06.884764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.885780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.886558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.888035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.889437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.890068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.931244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.940093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d7bff6e6-e879-4fdc-ab99-52233724bb09 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.170696 Sep 02 21:25:06.940778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 64/115] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:06 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:07.054541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.063899 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4adffeba-e30b-4ff1-a147-736807f34b17 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.192603 Sep 02 21:25:07.064850 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 52/116] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:06 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:07.263993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:07.265055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:07.271458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.272124 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.272569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.273274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.273787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.275312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.291052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:07.291983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:07.309788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.309788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.309788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.309788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.310856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.310856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.536627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.540729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.554718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9dc1d9c-693d-49be-9ba5-5e5693b2f426 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.272733 Sep 02 21:25:07.569638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.570318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 53/117] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:07 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:07.578112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.579586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8fd43850-b945-4676-8cbc-87a49bc57fa3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.321123 Sep 02 21:25:07.580735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 65/118] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:07 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:07.600921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2f4ef0-ee14-44b1-aced-1da687734ffa", "tag": "6fb427ad-794c-4ae8-8f2e-cc4bea6ef643"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:07.621726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.622825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.624383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.646084 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Creating event network-changed:6fb427ad-794c-4ae8-8f2e-cc4bea6ef643 for instance ff2f4ef0-ee14-44b1-aced-1da687734ffa on hv-cinder-85221 Sep 02 21:25:07.646620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 21:25:07.647016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-99944054-d3c4-4fb8-99a3-155ed201e7d5 req-4e96f61c-43e0-488a-8112-97cfca08bcc8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 21:25:07.648137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.648615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.649661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.650432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.651136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.651735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.661378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.compute.rpcapi [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 21:25:07.662380 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] Releasing lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 21:25:07.682175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2061dd77-4981-40a0-aaa6-a75602757d5b None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084318 Sep 02 21:25:07.683268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 54/119] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:25:07.968396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:07.969444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:07.979616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.979616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.979616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.980179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.980796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.981331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.088771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:08.090162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:08.100509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.101353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.102304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.103333 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.104160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.105193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.115559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:08.159563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.213127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c3fb2dba-1a7b-47d1-a14f-b1f456afcdd6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.251157 Sep 02 21:25:08.224779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 66/120] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:07 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:08.325453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.333143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-81ed45b1-f074-4fdd-8e9c-19d7c97da00f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.249221 Sep 02 21:25:08.346128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 55/121] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:08 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:08.580276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:08.580889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:08.587825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.588320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.588743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.589463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.589950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.590408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.623887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:08.623887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:08.623887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.623887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.624159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.624159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.624159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.624159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.811118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.819954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-72817247-2102-4f46-ad9d-fbabd3bca405 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.243529 Sep 02 21:25:08.820970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 67/122] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:08 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:08.847292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.856470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.857944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.859331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-05eab6a8-6f12-49ac-a9a6-71febeb76542 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.255184 Sep 02 21:25:08.860545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 56/123] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:08 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:09.244873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:09.245815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:09.252404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.252898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.253349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.254104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.254570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.254991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.358856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:09.359641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:09.367589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.369093 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.369852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.371293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.372246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.373024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.566536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:09.579499 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a3c41f49-b6d6-44a6-82ba-572ef4652550 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.340294 Sep 02 21:25:09.581236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 68/124] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:09 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:09.618841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:09.628952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c537f9ea-cb80-4a90-9a57-354f5dcca546 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.274417 Sep 02 21:25:09.642142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 57/125] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:09 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:09.855642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:09.856501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:09.863893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.864478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.865012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.865836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.866342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.866841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.885830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:09.886451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:09.893119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.893615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.894350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.895132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.895592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.896188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.076743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.085504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef3212ea-0bf7-4619-97fd-9d53667c5aa0 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.237998 Sep 02 21:25:10.090183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 69/126] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:09 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:10.133128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.146531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.150616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.153059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-59297a1d-9a24-4e18-9aca-c56b551001a5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.272052 Sep 02 21:25:10.154665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 58/127] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:09 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:10.636915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:10.641749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:10.648615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.649129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.652256 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.654447 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.655393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.657213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.658193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:10.659151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:10.674518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.675196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.675859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.676760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.677397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.677881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.908975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.921167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.924740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-01656fcd-1e7d-4b0a-a5d6-777347769af8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.310791 Sep 02 21:25:10.930347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6162c2cf-108d-424e-9d23-956d995971fb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.276941 Sep 02 21:25:10.932660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 59/128] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:10 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:10.942685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 70/129] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:10 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:11.117577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:11.119440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:11.130630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.131425 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.132241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.133355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.134746 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.135971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.190398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:11.192138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:11.201611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.203429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.204555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.206106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.207070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.207954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.240305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:11.425141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.438854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.439454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d9b15177-e47c-4dd9-9dd1-333f9b8cfa6c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.328412 Sep 02 21:25:11.439645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 60/130] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:11 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:11.448631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.450482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.452419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-59b1440d-7dd4-4fe8-aca4-f82d0e6f2949 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.267677 Sep 02 21:25:11.466616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 71/131] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:11 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:11.962574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:11.962574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:11.970696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:11.971404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:11.979410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.979966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.980538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.981276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.981845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.982000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.982210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.982989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.983804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.985144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.988523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.990076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.367786 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.377831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.382233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f49ab9e1-a926-4395-85ae-65081ac7b71f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.428981 Sep 02 21:25:12.391129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-669147ac-7676-48c5-a7b9-3e44876b2780 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.426528 Sep 02 21:25:12.392001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 72/132] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:11 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:12.403909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 61/133] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:11 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:12.469223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:12.470024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:12.492147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.493188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.499121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.500644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.505276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.506317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.595981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd02634-3dc0-41cf-996f-9f0d3962e44f", "name": "network-vif-plugged", "status": "completed", "tag": "57567b04-131e-41d4-9c37-96358cb8fe16"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:12.617450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.623997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.624603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.657869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] Creating event network-vif-plugged:57567b04-131e-41d4-9c37-96358cb8fe16 for instance ebd02634-3dc0-41cf-996f-9f0d3962e44f on hv-cinder-85221 Sep 02 21:25:12.669706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a5ab7d05-47be-469a-833d-defb047c4fee req-8bd93d7e-9ad0-491e-92a4-e474d31ffd85 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276259 Sep 02 21:25:12.670810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 73/134] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:12.692915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:12.696714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:12.705646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.706564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.707189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.708820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.709490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.710170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.046327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.060750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e70b1993-fb04-4811-856e-dba168904dd8 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.599421 Sep 02 21:25:13.087811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 62/135] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:12 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:13.404860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.414676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.416532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:13.417570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.418063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:13.418967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-15ced972-1f77-4dee-9e35-4405879614f9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.746892 Sep 02 21:25:13.429750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 74/136] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:12 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:13.429750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:13.429750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:13.434497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.435330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.435993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.437019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.438007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.438755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.457034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.457034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.457034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.458905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.459499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.460413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.714075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.723154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fd932b92-e19f-458e-99ba-a829fee041b3 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.302114 Sep 02 21:25:13.724066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 75/137] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:13 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:13.725833 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.735216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-071b3b7e-cf90-4206-b315-3f4b4a6e8bab tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.329782 Sep 02 21:25:13.737650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 63/138] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:13 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:14.091601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:14.092718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:14.101117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.101629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.105841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.105841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.105841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.105841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.301366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.310372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fcdb2fde-167b-4599-aa01-ef33a65e6946 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.226532 Sep 02 21:25:14.311167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 76/139] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:14 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:14.462297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:14.463558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:14.470143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.470632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.471068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.471913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.472368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.472792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.647447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.659377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.661252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.662461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ccc66ce1-1a4c-437a-ac77-4e762bc0da5b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.204437 Sep 02 21:25:14.663072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 64/140] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:14 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:14.708687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa471e49-7a31-4503-bb55-d08d1eaccc88", "name": "network-vif-plugged", "status": "completed", "tag": "da88f783-6182-4201-aeab-8bef35459820"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:14.724343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.724828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.725666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.743186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] Creating event network-vif-plugged:da88f783-6182-4201-aeab-8bef35459820 for instance aa471e49-7a31-4503-bb55-d08d1eaccc88 on hv-cinder-85221 Sep 02 21:25:14.747456 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-039632a0-83b8-48cd-a736-232d83f3423c req-096fcd15-8a29-4f55-87c7-3be735bd6a7e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042869 Sep 02 21:25:14.748280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:14.748493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 77/141] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:14.748905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:14.756574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.757382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.758268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.760387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.761180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.761898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.764370 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:14.765898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:14.778958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.783504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.783504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.783504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.783504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.783870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.084405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.088022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.105275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-897a4763-6965-4b34-a3e7-7776e67dd6ee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.360554 Sep 02 21:25:15.105568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c06196ed-39de-46d8-8b91-837d556e2a8d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.345707 Sep 02 21:25:15.106535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 65/142] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:14 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:15.110094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 78/143] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:14 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:15.333676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:15.334319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:15.341412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.341960 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.342437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.343160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.343627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.344060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.530558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.539337 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-600c0a7e-1c8e-468b-aa73-5d34ecbc727c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.209506 Sep 02 21:25:15.540046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 66/144] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:15 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:15.697922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:15.699216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:15.706457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.707108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.707563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.708356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.709042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.709609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.864325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.874445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.876329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.878127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8cc0aad6-a910-4efc-9f49-5a00985b613c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.186401 Sep 02 21:25:15.878802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 79/145] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:15 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:16.147370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.153337 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.155150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.156803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.181132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.183535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.183535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.184647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.185451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.186052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.187925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.188719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.189760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.190430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.191016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.198773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.501429 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.512744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b830e373-fe42-4198-9205-73b5f04dbc8e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.384666 Sep 02 21:25:16.515318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 67/146] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:16 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:16.518335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.534441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fc7e3b97-02a6-41c4-b270-9e05f669fb27 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.398116 Sep 02 21:25:16.535064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 80/147] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:16 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:16.563865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.564587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.571190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.571676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.572648 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.573357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.573912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.574338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.740742 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.758314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c1ed915b-8a06-4c43-9427-ad54573ca467 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.198582 Sep 02 21:25:16.761312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 68/148] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:16 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:16.904455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.905130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.912210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.912711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.913146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.913984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.914463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.914953 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.073250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.086002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.088559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.090181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-78a1681e-5acd-46c9-a077-c34b7edf29bf tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.190224 Sep 02 21:25:17.091371 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 81/149] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:16 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:17.539211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:17.539899 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:17.549293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.549842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.550292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.552263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.552263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.552263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.560245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:17.560957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:17.568376 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.568921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.569359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.570146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.570843 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.571666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.658984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:17.828877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.837051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5d05e612-646d-4869-8652-15ed2a78ac1c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.302976 Sep 02 21:25:17.838392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 69/150] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:17 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:17.841614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.843640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:17.844503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:17.852744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.853640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.854138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.854994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.855503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.855992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.866083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1453454d-63e5-4e87-ab4e-8d62e53f6294 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.301111 Sep 02 21:25:17.886334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 82/151] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:17 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:18.023417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.032857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4852319e-fa20-4326-a8cb-f19ef690aeaa tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.193192 Sep 02 21:25:18.033471 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 70/152] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:17 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:18.124860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:18.125468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.131942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.132435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.132880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.133565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.134039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.134476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.313093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.329613 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.332161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.334392 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d528260a-cd6c-4974-aeeb-08e7f6bfa25d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.213371 Sep 02 21:25:18.335347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 83/153] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:18 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:18.866701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:18.867237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.874137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.874635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.875087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.875792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.876373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.876808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.904316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:18.905165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.923131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.923943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.924381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.925086 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.925537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.926226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.085317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.089340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:19.093942 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bd52a26c-2d07-446a-a352-8be7f2e04bf2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.231522 Sep 02 21:25:19.095045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 71/154] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:18 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:19.099139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:19.099749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:19.113517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.113517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.113517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.113517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.114326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.114326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.172973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.181225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a84033c7-fe21-41b7-a140-4649c4c658cf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.281047 Sep 02 21:25:19.184104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 84/155] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:18 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:19.278912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.286885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e5bdbc24-58bf-448c-94fa-2bc27e57432c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.191216 Sep 02 21:25:19.287474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 72/156] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:19 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:19.361265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:19.361918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:19.384251 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.385561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.386761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.389217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.389217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.390126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.712355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.723366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.729579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.730955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0eb1ad66-2e26-412e-918d-bcb385b1e6b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.373591 Sep 02 21:25:19.733242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 85/157] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:19 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:19.758878 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf9bb41-be89-4802-ba81-6eb3fa5ebb68", "name": "network-vif-plugged", "status": "completed", "tag": "97b914ee-5150-4e32-adc8-6632678fd9f8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:19.773336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.774420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.775308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.799622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] Creating event network-vif-plugged:97b914ee-5150-4e32-adc8-6632678fd9f8 for instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 on hv-cinder-85221 Sep 02 21:25:19.801598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c4e9a8d4-86aa-47b9-8b5c-f963a2b691ea req-23926b4c-5353-48cf-a191-464c0d2b1175 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047355 Sep 02 21:25:19.802221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 73/158] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:25:20.118606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.119763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.126027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.126517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.127290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.127988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.128446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.128867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.210502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.212344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.228042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.229050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.229829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.230197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.230686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.231109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.356978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.365025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4dd21d77-a237-4432-8767-88470f23de68 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.250340 Sep 02 21:25:20.365610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 86/159] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:20.370586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.376092 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.377936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.378440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.378879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.379569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.380019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.380432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.405266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.414813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f8ea2340-44d4-49d3-aeab-7f05f69a05ba tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.210714 Sep 02 21:25:20.426469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 74/160] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:20.548103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.559319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c84c11b0-b203-4b1f-8d92-5687c65ac312 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.192656 Sep 02 21:25:20.560770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 87/161] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:20.757056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.757674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.764451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.764919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.765363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.766088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.766553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.766978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.917025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.928317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.929958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.931069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-651576d9-bd01-4e55-901c-82eeac7549cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.178084 Sep 02 21:25:20.931981 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 75/162] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:21.388891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.389623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.395931 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.396490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.397009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.397805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.398323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.398817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.440137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.440837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.459815 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.460404 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.460845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.462135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.462263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.462636 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.602906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.643123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-83b2fab0-7ab7-4f5c-bbbc-5aac7b50c4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.258740 Sep 02 21:25:21.643903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 88/163] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:21.649392 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.651735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.659150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.659641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.660077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.662966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.662966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.662966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.665131 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.676565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4387660-3a6f-4236-91c7-33929d4d5386 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.240995 Sep 02 21:25:21.677297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 76/164] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:21.683572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:21.805645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.814526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-08d312bc-ddcb-43c5-9240-fbab0652f549 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.169401 Sep 02 21:25:21.815184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 89/165] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:21.958776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.959468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.966052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.966619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.967126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.967891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.968418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.968849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.133217 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.143001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.144497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.145633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a49e13a8-e945-4881-ac8b-58b9d56ae155 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.191057 Sep 02 21:25:22.147089 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 77/166] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:22.668074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:22.673322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:22.675652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.676145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.676583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.677310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.678005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.678215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.702666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:22.703534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:22.715640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.716257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.717271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.719219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.722258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.722830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.899585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.909684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3c17dcc9-a308-42d0-84d0-044474c32e61 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.246969 Sep 02 21:25:22.910313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 90/167] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:22 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:22.918412 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:22.919365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:22.927922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.928555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.931087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.931087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.931087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.931087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.939000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.947202 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ca48837-a063-420e-a12c-ebaf0936e7bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.250270 Sep 02 21:25:22.947890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 78/168] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:22 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:23.097831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.106347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aa5be542-aa87-4e8d-ad67-280c70fa1df5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.194887 Sep 02 21:25:23.106970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 91/169] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:22 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:23.171962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:23.172561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:23.174767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=91 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:23.179546 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.180094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.180528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.181220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.181671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.182870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.345347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.355201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.356539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.357813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9b08199-6a0e-490d-99b2-65eaacf09c09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.189862 Sep 02 21:25:23.358378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 79/170] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:23 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:23.933150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:23.933870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:23.939972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.940473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.940917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.941812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.942282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.942729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.972313 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:23.972940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:23.979506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.979992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.980473 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.984751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.984751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.984751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.161674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.170159 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d6921ce5-fd5a-4cd1-ade6-f3e609afd62a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.241121 Sep 02 21:25:24.170735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 92/171] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:23 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:24.175485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:24.176454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:24.184576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.186249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.187545 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.188802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.189751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.190510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.200372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.212547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5c06529a-096f-46b2-9854-d32a93fe5545 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.244945 Sep 02 21:25:24.213901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 80/172] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:23 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:24.353762 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.362154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f7eed5b6-710a-482c-845e-75fe57c53248 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.190213 Sep 02 21:25:24.369409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 93/173] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:24 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:24.384564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:24.386376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:24.393212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.393705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.397962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.397962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.397962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.397962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.552651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.563057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.564533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.565665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a476520d-e355-46e9-8db9-55178fdd7a78 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.185345 Sep 02 21:25:24.566388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 81/174] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:24 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:25.195623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.196229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.204700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.205174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.205644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.206387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.206837 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.207394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.246078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.246078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.248635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.249618 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.250452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.251754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.252300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.252969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.403981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.413502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4b3fa69d-2658-46a2-8bbc-33dfec7c294b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.221760 Sep 02 21:25:25.425748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 94/175] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:25.425748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.425748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.426299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.426787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.427233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.427917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.428364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.428790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.453523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.462048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cd1b45b4-4beb-4562-bf2a-898897916bcf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.224786 Sep 02 21:25:25.462850 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 82/176] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:25.572362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.580093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-65c6c8d5-a353-42b4-a36d-689aff388d4d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.164997 Sep 02 21:25:25.580795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 95/177] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:25.593365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.594033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.600118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.600608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.601046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.601789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.602249 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.602681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.751445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.761066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.762587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:25.763869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-07e27693-536c-49c8-9bb2-eb8e17666325 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.175943 Sep 02 21:25:25.764886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 83/178] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:26.440573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:26.441492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:26.449861 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.451027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.451538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.452315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.452889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.458917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.494925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:26.495564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:26.508981 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.510227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.512718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.513484 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.513991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.516618 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.752261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.761468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-37014641-fa4a-4718-89ec-c0de301d4d41 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.324061 Sep 02 21:25:26.762092 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 96/179] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:26 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:26.769936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:26.769936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:26.775949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.777165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.777638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.778382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.778846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.780942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.798412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.806475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f3020e20-c7c8-4887-b85a-ff7b87aecfbb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.318016 Sep 02 21:25:26.807173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 84/180] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:26 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:26.813611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:26.814354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:26.822712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.823516 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.826964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.826964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.826964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.826964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.974148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.985444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4caf56d2-2cf9-4d9b-bafd-102fdc8f3834 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.221930 Sep 02 21:25:26.987386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 97/181] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:26 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:27.083265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.103654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.106945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.108760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c1e8172e-bf0b-4086-87b8-73af9ec8d1be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.299405 Sep 02 21:25:27.109291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 85/182] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:26 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:27.192440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2f4ef0-ee14-44b1-aced-1da687734ffa", "name": "network-vif-plugged", "status": "completed", "tag": "6fb427ad-794c-4ae8-8f2e-cc4bea6ef643"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:27.203305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.203797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.204239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.216967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] Creating event network-vif-plugged:6fb427ad-794c-4ae8-8f2e-cc4bea6ef643 for instance ff2f4ef0-ee14-44b1-aced-1da687734ffa on hv-cinder-85221 Sep 02 21:25:27.222565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-c19f55ba-9b7d-4ad7-a014-0b45b8d47109 req-420db1b6-6047-4f5f-beb2-5d9213acbc9a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033739 Sep 02 21:25:27.223452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 98/183] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:27.786827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:27.787843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:27.801391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.802250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.806097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.806097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.806097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.806097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.833899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:27.836206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:27.845128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.846001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.846990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.848516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.848995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.849434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.042565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.053807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0f36355e-c8b5-498b-aa4a-90395cd9dbdd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.271945 Sep 02 21:25:28.054630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 86/184] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:27 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:28.068025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.076726 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7122ef57-7f24-4751-a2c1-330bf7a669a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.249661 Sep 02 21:25:28.077643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:28.078301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:28.084717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.087749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.087749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.087749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.087749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.088102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.092793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 99/185] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:27 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:28.154832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:28.155457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:28.164319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.164873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.165268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.166005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.166473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.167458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.259607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.272979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7630818d-ef8a-4db2-9912-66700e7cbb60 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.205019 Sep 02 21:25:28.286887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 87/186] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:28 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:28.601555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.609789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.611534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:28.613633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-583495c8-184f-4ab8-9e50-bbcbfc471b1a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.462175 Sep 02 21:25:28.614603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 100/187] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:28 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:29.080461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:29.081082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:29.087419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.087919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.088357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.089180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.089738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.090192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.107018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:29.108313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:29.113675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:29.119363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.120860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.121676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.123004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.123836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.124640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.303617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.312556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d08fa2b0-ebb9-4514-b820-f9b77428fdc2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.235960 Sep 02 21:25:29.323625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 88/188] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:29 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:29.328898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:29.329068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.329578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:29.335817 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.336951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.337397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.337504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5a1fc45e-5226-4cd2-8db8-bc367f3fc804 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.238959 Sep 02 21:25:29.338238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.343548 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 101/189] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:29 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:29.343740 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.343740 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.344336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:29.482972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.496975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-66a14872-4df7-41d9-b576-f2f2ab724c1c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.172307 Sep 02 21:25:29.498712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 89/190] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:29 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:29.639729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:29.640453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:29.647500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.647993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.648448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.649130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.649576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.650033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.846115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.855696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.857226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.858429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-515bd19b-e68c-4f78-8c3a-8162ee757d51 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.223316 Sep 02 21:25:29.859008 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 102/191] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:29 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:30.335395 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.336004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.343052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.343533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.346419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.346419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.346419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.346419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.365138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.365138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.375278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.375278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.375278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.375278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.375747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.376268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.573668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:30.577745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:30.582003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ec92df49-11b9-4932-98cf-90f4efa8ac54 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.250372 Sep 02 21:25:30.582591 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 90/192] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:30.586479 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7d3836f0-3be1-42e6-9e77-12d71fa3db9a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.227371 Sep 02 21:25:30.601741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 103/193] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:30.602883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.603524 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.610409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.610902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.611402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.612125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.612497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.612924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.771797 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:30.783677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b207ab96-beff-4b7d-afb3-9d22a4160d4a tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.196914 Sep 02 21:25:30.783677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 91/194] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:30.885285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.886630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.892728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.893265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.893697 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.894442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.894890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.896012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.045793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.056374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.058384 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.059675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7b7de8f4-f4df-4ada-a9ff-1251131cc91c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.178513 Sep 02 21:25:31.060433 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 104/195] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:31.663406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:31.663406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:31.663406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.663406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.664126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.664126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.664126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.664364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:31.664743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.664817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:31.664817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.664817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.664817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.665094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.665094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.665094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.819031 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.823091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.831663 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-254e9d05-990d-43c5-89cd-9ae14ce9090e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.230895 Sep 02 21:25:31.831876 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b5385528-250f-41ee-93d1-3c322001ad85 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.220599 Sep 02 21:25:31.832248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 92/196] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:31 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:31.832379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 105/197] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:31 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:31.837379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:31.838265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:31.844607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.845221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.846012 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.846524 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.847033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.847717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.039909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.049633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9b580899-fe74-4a49-af12-9d6deecb02d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.215706 Sep 02 21:25:32.050204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 93/198] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:31 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:32.084506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:32.085112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:32.092334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.092816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.093255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.094042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.094500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.094918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.232888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.236556 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:32.241570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.243051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.244206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8274dc78-c45b-4c1e-9e0c-45f74e935dd1 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.163601 Sep 02 21:25:32.244753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 106/199] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:32 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:32.861216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:32.878298 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:32.878467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:32.878467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:32.880828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.881342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.881806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.885155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.885643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.886110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.886813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.887302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.890029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.890481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.890978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.891417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.184113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.194168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fff9d0be-9139-4a65-b7c5-326fe708eb98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.342527 Sep 02 21:25:33.194893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 94/200] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:32 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:33.199419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:33.200763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:33.201567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.207640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.208135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.208579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.209476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.210092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.210521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.211252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-922fc595-e6ee-43b2-8148-8e2cc12fefd6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.355349 Sep 02 21:25:33.211847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 107/201] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:32 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:33.270259 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:33.270876 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:33.277187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.278032 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.278466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.279358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.280001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.280574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.462658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.471139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d95ab812-7fe9-4b0c-8ca9-4f92641fb164 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1314 microversion: 2.1 time: 0.275201 Sep 02 21:25:33.471726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 95/202] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:33 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:33.488243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.497551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.499051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:33.500211 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-353d36ab-c68f-4ba1-9e74-c41f87a7b091 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.233894 Sep 02 21:25:33.500781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 108/203] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:33 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:34.218779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:34.219592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:34.229422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.241366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:34.241366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:34.242678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.243793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.245810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.250293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.254191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.271379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.276863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.278091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.279554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.284285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.287303 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.547266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.547511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.557007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a0bcb443-c41f-4a54-866b-3b22fd679c6a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.326086 Sep 02 21:25:34.557764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 109/204] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:34 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:34.557907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-99f11cd0-c57f-4417-8c32-f1cf83d63f7c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.343638 Sep 02 21:25:34.558373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 96/205] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:34 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:34.563311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:34.564173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:34.575955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:34.577009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:34.582349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.582994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.583410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.583523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.583916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.584145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.584353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.584600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.585024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.585135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:34.585506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:34.586015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.815375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.818582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.826364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.827902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.828347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-166117f4-2bf8-4d3e-9988-1f4d67530841 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1500 microversion: 2.1 time: 0.268850 Sep 02 21:25:34.829287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f42e7f88-9d49-47e0-a195-fdcc9ec85d0f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.269814 Sep 02 21:25:34.829489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 110/206] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:34 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1500 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:34.830209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 97/207] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:34 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:35.378482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "name": "network-vif-plugged", "status": "completed", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:35.391009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.391491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.391925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.404115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] Creating event network-vif-plugged:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:25:35.409070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-2e108668-ae20-48b3-8610-89b7cc0e44ca req-1e7c024a-0a7c-4201-aef1-bf70c44d1b88 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037269 Sep 02 21:25:35.411867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 111/208] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:35.586443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:35.587602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:35.597289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:35.598168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:35.599021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.599915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.600743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.602057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.603069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.603890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.605036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.605529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.605990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.607236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.607689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.608270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.917036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.923888 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.928537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fcb6b408-c818-42d6-a19c-aaa2e2fa01a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.335272 Sep 02 21:25:35.929100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 112/209] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:35 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:35.935154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:35.936109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:35.948476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.948476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.948476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.948476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.948786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.948786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.948951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6bb0535d-55bb-4ed6-b473-3255afd0ab97 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.369646 Sep 02 21:25:35.951206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 98/210] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:35 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:36.228515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:36.241644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:36.243763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:36.245308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-587be51e-c85c-4794-b0c7-8c8702dc184c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.314865 Sep 02 21:25:36.246413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 113/211] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:35 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:36.972689 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:36.975787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:36.993641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:36.994498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:37.003593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.004740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.005650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.007448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.009618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.010891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.011699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.011818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.012398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.013547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.015515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.017202 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.337310 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.342263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.349107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-691a200a-af3f-47a8-820c-1a4dff92b2bd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.381472 Sep 02 21:25:37.350919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3a13a139-4bea-4654-b8ca-837c47ec9a2b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.364875 Sep 02 21:25:37.351202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 114/212] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:36 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:37.355733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:37.356334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:37.360428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 99/213] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:36 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:37.362979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.363473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.363903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.364594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.365048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.365470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.516484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.524779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.526276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.527378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dc3af297-bf76-4fe7-8fde-8ad57d400b63 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.175313 Sep 02 21:25:37.527943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 115/214] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:37 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:37.978899 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2588f22e-6898-4778-82a9-3a0a6990da84"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:37.982900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:37.988902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.989492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.990147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.990853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.991347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.991773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.375449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:38.376119 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:38.382598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.388708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.388708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.388708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.388708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.389534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.523524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:38.532672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca9db8d2-3ab6-4186-b368-c82399fae7dd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.162058 Sep 02 21:25:38.533322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 116/215] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:38 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:38.538324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:38.538926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:38.545424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.545941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.546381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.547095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.547534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.547990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.695974 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:38.704161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-26b81aa4-4b7a-4a1a-9e0e-ffd5a031b76f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.169674 Sep 02 21:25:38.705008 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 117/216] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:38 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:38.722680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:38.723475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:38.730193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.730855 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.731303 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.732514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.733208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.733601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.891141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:38.900336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:38.902011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:38.903144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7002a4c2-15b8-43e5-983d-475de4b8a103 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.197375 Sep 02 21:25:38.903806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 118/217] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:38 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:39.559428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:39.560548 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:39.566183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.566612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.567178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.567739 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.568194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.568620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.705116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.713072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3b771ea9-4f47-4fe5-a04d-a26cd5ffe41c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.157474 Sep 02 21:25:39.713645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 119/218] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:39 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:39.727301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:39.727926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:39.734740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.735319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.735835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.736550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.737075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.737583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.879639 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.887958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-14086d82-0f1b-4cba-93a3-a300d5830486 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.164322 Sep 02 21:25:39.889307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 120/219] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:39 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:39.934448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:39.935569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:39.941604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.944783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.944783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.944783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:39.944783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:39.945134 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:40.078843 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:40.087217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:40.088737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:40.089871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e4087136-e863-48a0-8d65-7916bd1f7d2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.165236 Sep 02 21:25:40.090429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 121/220] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:39 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:40.737499 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:40.738165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:40.744247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.744823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.745163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:40.748581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.748581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.748581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:40.895188 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:40.905484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-de03abd3-8678-4353-b7b5-2acf145da6c5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.172122 Sep 02 21:25:40.906738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 122/221] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:40 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:40.928346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:40.928346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:40.928346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.928346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.928685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:40.928685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.929030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.929457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.062974 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.070785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6392ab82-686b-44a4-9561-bf49a80a2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.162637 Sep 02 21:25:41.071355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 123/222] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:40 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:41.115867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:41.116394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:41.123157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.123657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.124097 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.124808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.125260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.125691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.130249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:41.267118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.276261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.277841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.279445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bc2b9853-9388-446b-aba5-1312de9c0ff5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.167096 Sep 02 21:25:41.280266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 124/223] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:41 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:41.932481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:41.933170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:41.940784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.941374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.941976 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.943222 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.943888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.944390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.083685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.091385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-47fc5fb2-8487-4f1e-b7c8-86d5bcee42f7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1362 microversion: 2.1 time: 0.163239 Sep 02 21:25:42.092458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 125/224] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:41 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:42.097002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:42.097606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:42.103350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.103821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.104252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.104934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.105398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.105821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.239551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.247397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef1e2d48-2527-4e5a-87da-c2ccd9468575 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.153891 Sep 02 21:25:42.248261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 126/225] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:42 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:42.308444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:42.309076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:42.315196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.315700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.316118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.316809 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.317262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.317691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.446603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.456033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.457600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.458732 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d5f85552-83cc-4df4-baac-3abe2bd80b86 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.154311 Sep 02 21:25:42.459289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 127/226] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:42 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:43.114744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:43.115402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:43.121370 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.121895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.122330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.123016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.123464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.123884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.256042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:43.264306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-98a56165-d871-4a01-a057-af424de02973 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1548 microversion: 2.1 time: 0.153333 Sep 02 21:25:43.264864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 128/227] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:43 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:43.271046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:43.271741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:43.277704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.278213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.278648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.280536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.280999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.281426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.425324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:43.433102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-928097ce-7e60-4657-ba41-4ba3fb0aa3b9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.166031 Sep 02 21:25:43.433670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 129/228] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:43 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:43.438298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:43.438780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:43.445064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.445594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.446043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.446750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.447273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.447664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.566313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-423f5a21-4dce-4153-919b-c947ce0e86c6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131526 Sep 02 21:25:43.566918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 130/229] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:25:43 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:43.571624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:43.572225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:43.578896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.579387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.579824 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.580521 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.580971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.581390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.080460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.089445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.090962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.092662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-58b5fcde-3372-4bea-b569-4c5d1ecc9870 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.524809 Sep 02 21:25:44.093221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 131/230] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:43 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:44.456101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:44.456773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:44.462828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:44.463319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:44.463755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.464514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:44.464966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:44.465393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.614083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.622982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1ab92a77-e7ae-4d84-b6ca-9b2423b52aa8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.170605 Sep 02 21:25:44.624426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 132/231] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:44 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:45.129199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:45.129980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:45.136803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.137477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.137896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.138996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.139551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.140041 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.331135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.337403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.338912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.340050 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e623651f-b260-4843-b354-628c16acdfb6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.217185 Sep 02 21:25:45.340620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 133/232] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:45 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:45.346172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2f4ef0-ee14-44b1-aced-1da687734ffa", "tag": "6fb427ad-794c-4ae8-8f2e-cc4bea6ef643"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:45.356743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.361614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.361614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.370390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] Creating event network-changed:6fb427ad-794c-4ae8-8f2e-cc4bea6ef643 for instance ff2f4ef0-ee14-44b1-aced-1da687734ffa on hv-cinder-85221 Sep 02 21:25:45.376372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-071474ba-8917-4bc0-a828-461738804b45 req-72405a05-f7d8-4a06-91f3-de8d60524f17 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034561 Sep 02 21:25:45.377119 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 134/233] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:45.649404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:45.650068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:45.656982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.657472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.658117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.658822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.659288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.659703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.799029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.806774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5f2fb9d8-362f-4d5a-92d0-26037710845e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.161726 Sep 02 21:25:45.807355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 135/234] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:45 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:46.382429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:46.383498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:46.392834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.393439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.393900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.394612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.395070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.395490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.630150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.639599 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.641261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.642566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-919eb37b-5919-4001-b741-0f1c4c0f3711 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.264778 Sep 02 21:25:46.643361 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 136/235] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:46 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:46.831529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:46.832173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:46.840067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.840558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.840995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.841700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.842243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.843164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.990786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:47.000137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-75043699-98a3-4e4b-ac09-d09510fe735e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.173585 Sep 02 21:25:47.000719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 137/236] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:46 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:47.677068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:47.677673 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:47.683933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:47.684444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:47.684884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:47.685635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:47.686661 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:47.687044 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:47.818188 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:47.827681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:47.829413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:47.830784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1038881b-b891-4b72-9daa-6c5248bc7f89 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.157416 Sep 02 21:25:47.831400 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 138/237] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:47 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:47.986376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=43 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:48.028887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:48.030105 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:48.036530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.037013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.037628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.038543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.039152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.039745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.109913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=70 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:48.189871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:48.198231 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5178ff6d-d0cf-48ba-b4f6-7d6978de2d5b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1322 microversion: 2.1 time: 0.173111 Sep 02 21:25:48.198831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 139/238] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:48 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:48.856786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:48.857401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:48.864316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.864813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.865365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.865986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.866444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.866933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.994227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:49.003005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:49.004448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:49.005557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-38463786-00e2-407d-a3de-632594addbd8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.152972 Sep 02 21:25:49.006407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 140/239] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:48 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:49.221006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:49.221663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:49.228182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.228679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.229114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.229853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.230382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.230754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.363341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:49.366942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:49.371758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b9b4568-9e21-4c7e-b0cd-c0c8f39e52e3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1516 microversion: 2.1 time: 0.155199 Sep 02 21:25:49.372319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 141/240] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:49 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:49.395789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:49.398379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:49.405698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.406307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.406751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.407497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.407965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.408399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.432985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'flavor' on Instance uuid aa471e49-7a31-4503-bb55-d08d1eaccc88 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:25:49.756332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-896ae6ff-4436-472a-af93-53395f0aeda9 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88/action" status: 200 len: 32 microversion: 2.1 time: 0.364284 Sep 02 21:25:49.756962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 142/241] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:25:49 2022] POST /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 21:25:49.766760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:49.767446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:49.774636 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.775121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.775554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.776239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:49.776692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:49.777111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:49.916843 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:49.928470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d2e36d24-270e-4b69-892b-7123bb06b1ec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.165735 Sep 02 21:25:49.929052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 143/242] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:49 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:50.031517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.032302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.038292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.038774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.039210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.039899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.040350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.040810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.172355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.180897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.182416 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.183576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b40d1f21-a158-4d32-832f-cd4f7a3665e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.156662 Sep 02 21:25:50.184151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 144/243] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:50 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:50.952547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.953236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.960109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.960588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.961017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.961696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.962170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.962589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:51.272089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:51.280378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-889cb3d8-eba6-42a7-8087-142b31a2c207 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.331502 Sep 02 21:25:51.280990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 145/244] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:50 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:51.285458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:51.286617 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:51.291909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:51.292394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:51.292833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:51.293525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:51.294014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:51.294442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:51.433488 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:51.442480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:51.443733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:51.444864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-455d4c0a-64b5-4642-a645-a5047110181c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.162997 Sep 02 21:25:51.445417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 146/245] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:51 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:52.304708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:52.305346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:52.312326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.312886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.313334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.314083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.314542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.314971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.453023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.460877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e4580f8-5fd9-412b-836b-2d8f4c5da65b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.160094 Sep 02 21:25:52.461388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 147/246] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:52 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:52.472413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:52.473027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:52.479209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.479697 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.480136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.480838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.481294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.481741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.629530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.637841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.639808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.640910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-59901905-8d37-4f68-92ba-d801264859a9 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.173529 Sep 02 21:25:52.641464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 148/247] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:52 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:53.490247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:53.491533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:53.502701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.503205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.503649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.504368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.504833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.505267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.656475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.664555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e197e533-8ba6-4888-83ae-77f62cbfb18c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.182485 Sep 02 21:25:53.665531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 149/248] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:53 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:53.670367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:53.671574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:53.677478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.678193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.678691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.679385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.679834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.680533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.815332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.823785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.825316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.826469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-72e77500-0847-4b1f-b8fd-24c7e307bc49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.159922 Sep 02 21:25:53.827547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 150/249] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:53 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:54.183030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8d129823-ee98-4eaf-8510-88a3f7ca4cea tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "POST /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.208401 Sep 02 21:25:54.183616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 100/250] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:25:37 2022] POST /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f/os-volume_attachments => generated 194 bytes in 16210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:54.691423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:54.691423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:54.695533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:54.699290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.699970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.700490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.701399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.701807 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.702993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.846747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:54.853733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:54.854861 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2a096fce-b2a1-4cba-a357-948813544f62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.169999 Sep 02 21:25:54.857762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:54.858483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 151/251] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:54 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:54.879388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.879866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.880321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.881028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.882240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.882677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:55.065172 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:55.079246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:55.083013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:55.083013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ddb473fe-9d05-4888-a015-c34d01eab6af tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1407 microversion: 2.20 time: 0.232888 Sep 02 21:25:55.083013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 101/252] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:54 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:55.878823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:55.879360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:55.885619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:55.886133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:55.886564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:55.887250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:55.887700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:55.888120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.022614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.029649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bd5cc0a1-9f94-40b4-be3c-e0eb12b02933 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.155048 Sep 02 21:25:56.031176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 152/253] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:55 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:56.109034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:56.109642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:56.116253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.116791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.117223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.118231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.118692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.119166 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.256488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.264936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.266536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.267684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e57a9722-a110-461e-aef9-e5fb2e35bc5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1598 microversion: 2.20 time: 0.162939 Sep 02 21:25:56.268250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 102/254] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:56 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:56.293993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:56.294519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:56.301349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.301870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.302306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.302992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.303439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.303854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.382947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d59a42d0-06b1-4990-bc9e-0006a04baec4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093175 Sep 02 21:25:56.383625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 153/255] 10.222.0.99 () {60 vars in 1316 bytes} [Fri Sep 2 21:25:56 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:25:57.053635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:57.054476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:57.060634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.061122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.070372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.070372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.070372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.070372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.288466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.298989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-199384d7-b916-4b5f-bd85-9dd9b20ad351 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.249131 Sep 02 21:25:57.299810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 103/256] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:57 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:57.614904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:57.626120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.626693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.627202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.639271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] Creating event network-changed:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:25:57.647210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-5528bf1a-08b6-41d6-adb4-6957ea24e237 req-0ef7e514-5fc1-43a4-9d0f-a2b50b9c10fc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035818 Sep 02 21:25:57.648045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 154/257] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:58.332350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:58.334943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:58.344023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.344659 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.345052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.345734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.346188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.346616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.491513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.499671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c7875bbb-eb11-4266-bfbf-f91d66a91340 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.171851 Sep 02 21:25:58.500251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 104/258] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:58 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:59.523555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:59.524286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:59.530643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.531224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.531701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.532408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.532863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.533315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.668243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:59.676830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-082e7065-19c3-4a8d-aac0-00abf8c09195 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.157531 Sep 02 21:25:59.677389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 155/259] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:59 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:00.700872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:00.701494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:00.708967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.709456 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.709929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.710654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.711114 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.711550 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.839573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.847890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a5ade8ae-d1b0-4100-af4f-cc40d9355f83 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.151269 Sep 02 21:26:00.848453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 105/260] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:00 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:01.872363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:01.872875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:01.879577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.880055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.880483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.885640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.885640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.885640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.016784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.025057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-60088257-5b04-458e-9e3c-b8534b574c9b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.157427 Sep 02 21:26:02.025845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 156/261] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:01 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:03.054356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:03.055079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:03.063247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.063751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.064202 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.064911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.065368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.065829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.201064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:03.213102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4081cb08-ef37-4162-b53d-3b1a5ebc70b3 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.162939 Sep 02 21:26:03.213683 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 106/262] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:03 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:04.238238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:04.238902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:04.245102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.245579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.246039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.249067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.249067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.249067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.432786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:04.551766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.561930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ff96d530-207e-4bda-925b-8346ee73e120 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.326248 Sep 02 21:26:04.563258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 157/263] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:04 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:05.585105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:05.585731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.592029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.592519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.592962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.594313 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.594780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.595208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.758330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.766809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f5c66c40-cdb3-4e89-889a-7a608a4932fe tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.185575 Sep 02 21:26:05.767397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 107/264] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:05 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:06.791707 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:06.792242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:06.799826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.800331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.800754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.801452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.801940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.802367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.948779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:06.968632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e05dc972-f55c-4280-801b-19cce260aa37 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.171122 Sep 02 21:26:06.968632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 158/265] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:06 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:07.989160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:07.989889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:07.996463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.004228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.004228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.004228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.004228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.004872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.136541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:08.146107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-99f47cdb-4b27-4a03-9dd6-6a3ff97f236a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.160762 Sep 02 21:26:08.146983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 108/266] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:07 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:09.171010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:09.173144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:09.179620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:09.180180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:09.180681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:09.181440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:09.182181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:09.182604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:09.332835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:09.342197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-948d3291-5e8c-4e02-b197-6940f205cadd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.173585 Sep 02 21:26:09.342197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 159/267] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:09 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:10.363811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:10.364452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:10.371084 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.371564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.372050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.372739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.373192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.373619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.513136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.526013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e465fdc-2ed9-4426-8cb3-e4f72bddfbb0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.162308 Sep 02 21:26:10.526013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 109/268] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:10 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:11.546737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:11.547387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:11.555000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.555488 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.555929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.556677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.557153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.557570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.701648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:11.715013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a511cc67-0ad5-4f7b-9d2b-d5b5f8926837 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.172034 Sep 02 21:26:11.715600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 160/269] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:11 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:12.027769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:12.028339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.035682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.036424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.037039 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.037824 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.038463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.038957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.068780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:26:12.542456 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-92542349-d37a-47eb-b39f-eb48c85fe53f tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 204 len: 0 microversion: 2.1 time: 0.518109 Sep 02 21:26:12.543014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 110/270] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:26:12 2022] DELETE /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:26:12.551825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:12.553079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.558342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.559014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.559449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.560137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.560631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.561012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.710131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.717744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a34e67e1-61a4-4d14-b12f-e0d88fbd60b5 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.170121 Sep 02 21:26:12.718317 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 161/271] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:12 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:12.741059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:12.741929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.748910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.749401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.753822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.753822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.753822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.753822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.893546 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.901827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ab8ddeab-f5bb-4783-8edc-db90a6f094ee tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.165118 Sep 02 21:26:12.902443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 111/272] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:12 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:13.745037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:13.746841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:13.755232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.755817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.756472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.757283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.757965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.758401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.897261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:13.906380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-47f54035-bbed-4661-8eea-451820923d1d tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.168613 Sep 02 21:26:13.907013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 162/273] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:13 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:13.925090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:13.925752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:13.932302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.932778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.933211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.933933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.934385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.934854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.071664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.080056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9b1c832a-fe49-447e-9459-dfd9359d2b9f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.158896 Sep 02 21:26:14.080713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 112/274] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:13 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:14.930487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:14.931003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:14.936909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.937389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.937854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.939475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.939785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.940208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.074467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.083596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b575d42c-05ce-4712-8bc4-1c09f1b886d2 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.157048 Sep 02 21:26:15.084169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 163/275] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:14 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:15.103632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:15.104244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:15.111487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.111961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.112397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.113089 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.113544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.113993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.242418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.250322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3b366195-59cf-4935-91f0-f6fee3809957 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.150474 Sep 02 21:26:15.250936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 113/276] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:15 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:16.107162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:16.107778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:16.114487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.114908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.116090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.117000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.117472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.117966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.264272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.273350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2563add2-b09f-4042-919c-22f4b9028c37 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.170001 Sep 02 21:26:16.273949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 164/277] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:16 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:16.274061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:16.274685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:16.281351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.281880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.282453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.283125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.283589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.284049 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.303031 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:16.418142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.427371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9ee3723c-0ca6-4899-9a12-e1b3d9301922 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.157289 Sep 02 21:26:16.427982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 114/278] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:16 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:17.296237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.303977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.303977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.304185 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.305679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.305679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.305679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.306228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.442939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.452032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.452752 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f1225ffd-8f70-4338-bb28-10fb8956faa4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.160148 Sep 02 21:26:17.453242 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.453748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 165/279] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:17.466479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.466479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.466479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.466479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.466816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.466816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.621508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.630738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-617c85a9-cc46-4554-b935-c090c2b039ff tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.183605 Sep 02 21:26:17.637308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 115/280] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:18.477492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.478149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.484212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.484698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.485151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.490790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.490790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.490790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.640364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.652819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-43000cb3-a49b-4b72-8f87-e9cfe7350feb tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1552 microversion: 2.1 time: 0.179303 Sep 02 21:26:18.658977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.667753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.667753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:18.668174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 166/281] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:18.668868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.669497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.670398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.671941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.672411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.672842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.824615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.833335 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0a228318-018d-4602-a3eb-ccddbba162b8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.181014 Sep 02 21:26:18.833986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 116/282] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:19.542324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd02634-3dc0-41cf-996f-9f0d3962e44f", "name": "network-vif-deleted", "tag": "57567b04-131e-41d4-9c37-96358cb8fe16"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:19.552894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.553463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.553882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.565060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] Creating event network-vif-deleted:57567b04-131e-41d4-9c37-96358cb8fe16 for instance ebd02634-3dc0-41cf-996f-9f0d3962e44f on hv-cinder-85221 Sep 02 21:26:19.570426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-497d67c9-62ee-4143-9586-17afc87c97e2 req-9ee15335-cbc3-4203-92a7-b2a8d171cf41 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031813 Sep 02 21:26:19.571015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 167/283] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:19.679283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.679876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.686159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.686642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.687077 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.687804 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.688254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.688690 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.754908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.763472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-54f6bf86-4f4c-4517-ac13-cd9340476b7c tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1510 microversion: 2.1 time: 0.088426 Sep 02 21:26:19.769025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 117/284] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:19.861213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.862033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.868189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.868671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.869105 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.870030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.870481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.871059 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.052336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.060851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8e8e52d9-01bd-4e40-86e0-e062ce8b7a68 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.207133 Sep 02 21:26:20.061625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 168/285] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:20.791628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:20.792473 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:20.800818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.801288 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.801763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.802515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.802979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.803414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.867352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.875724 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8b75cdd8-5750-47d4-ad44-f7aa197f23ce tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1345 microversion: 2.1 time: 0.088036 Sep 02 21:26:20.880090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 118/286] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:20 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:21.084525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.085063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.090975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.091455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.091887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.092567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.093028 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.093441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.407637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:21.415409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5ea0495b-56ba-474e-8565-64e569e78516 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1522 microversion: 2.1 time: 0.334835 Sep 02 21:26:21.415971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 169/287] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:21.902281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.903075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.910681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.911169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.912474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.912474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.912819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.913358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.946170 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.946648 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.947078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.947531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lazy-loading 'fault' on Instance uuid ebd02634-3dc0-41cf-996f-9f0d3962e44f {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:26:21.992821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.001764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df30b7c2-5d2a-4d54-8edb-351e41ee7a1b tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1350 microversion: 2.1 time: 0.103235 Sep 02 21:26:22.002876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 119/288] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:22.439374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:22.440729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:22.447196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.447687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.458198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.458198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.458198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.458198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.588956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.597106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d3a346a1-7ac6-40fb-8105-855897db162e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1502 microversion: 2.1 time: 0.161990 Sep 02 21:26:22.597686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 170/289] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:22.619811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:22.620485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:22.627620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.628102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.628532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.629278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.629767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.630192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.768966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.778284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6bb1dcc1-cc5a-4c3c-b08f-f785a8c4be93 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1517 microversion: 2.1 time: 0.162242 Sep 02 21:26:22.778872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 120/290] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.025781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.026395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.032366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.033849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.034282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.035150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.035612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.036043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.069634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.070808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.071294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.071693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lazy-loading 'fault' on Instance uuid ebd02634-3dc0-41cf-996f-9f0d3962e44f {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:26:23.138890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8cfb5d2a34451bb21d47bd5aae44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b972cee2d99491096a0aba46391cec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.148162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-71e3f26d-49c4-4184-a5c1-e0de642ed8d7 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 200 len: 1350 microversion: 2.1 time: 0.126264 Sep 02 21:26:23.150069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 171/291] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:24.171154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.171771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.180574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.181384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.181857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.182573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.183300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.183745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.200491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] HTTP exception thrown: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Request method failure captured: Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f HTTP/1.1 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSNIMr73rT0BlqRNqTfM8AmhEcR7k9i0GfFUPtpyvr5dr21zpcpeVZNKnkRQMbz5tsLelcc32TMuhFqOPVy3myKvAI5t1fKer7KrwiuyAytTPGTX7iLT-ZlRG1O11AugwwqLPRnH3MUESlyhg3ABxbtqFqdDT5Detopt1zIIUhBgng Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:26:24.240405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4b972cee2d99491096a0aba46391cec6", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 0b8cfb5d2a34451bb21d47bd5aae44f4 Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.242252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ebd02634-3dc0-41cf-996f-9f0d3962e44f'} Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:24.243028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.244493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.245812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Returning 404 to user: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:24.245812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4fa8778-dd6a-4348-a857-a411af0b3534 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 404 len: 111 microversion: 2.1 time: 0.074749 Sep 02 21:26:24.245812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 121/292] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:26:24.630024 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.632374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.638730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.639219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.639676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.640352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.640815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.641336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.655846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] HTTP exception thrown: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Request method failure captured: Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f/os-volume_attachments HTTP/1.1 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSNIMr73rT0BlqRNqTfM8AmhEcR7k9i0GfFUPtpyvr5dr21zpcpeVZNKnkRQMbz5tsLelcc32TMuhFqOPVy3myKvAI5t1fKer7KrwiuyAytTPGTX7iLT-ZlRG1O11AugwwqLPRnH3MUESlyhg3ABxbtqFqdDT5Detopt1zIIUhBgng Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:26:24.660027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4b972cee2d99491096a0aba46391cec6", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 0b8cfb5d2a34451bb21d47bd5aae44f4 Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.661489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'server_id': 'ebd02634-3dc0-41cf-996f-9f0d3962e44f'} Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:24.662312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:24.663802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:26:24.665058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Returning 404 to user: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:24.665058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-de0a9217-c653-40e3-a999-0b0c8e116a79 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037651 Sep 02 21:26:24.665058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 172/293] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:26:26.591140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:26.593665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:26.602363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.608678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.608678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.608678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.608678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.609069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.631413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'flavor' on Instance uuid 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:26:27.153661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6331e92b-1e71-49eb-ae0f-e745ffce4a30 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/action" status: 200 len: 32 microversion: 2.1 time: 0.566762 Sep 02 21:26:27.158228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 122/294] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:26:26 2022] POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/action => generated 32 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:26:27.166867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.167781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.172799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=45 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:27.175004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.175554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.176299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.177407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.177907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.178347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.281051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.281637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.290321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.290813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.291254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.291953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.292407 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.292835 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.306958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] HTTP exception thrown: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Request method failure captured: Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f HTTP/1.1 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSNIMr73rT0BlqRNqTfM8AmhEcR7k9i0GfFUPtpyvr5dr21zpcpeVZNKnkRQMbz5tsLelcc32TMuhFqOPVy3myKvAI5t1fKer7KrwiuyAytTPGTX7iLT-ZlRG1O11AugwwqLPRnH3MUESlyhg3ABxbtqFqdDT5Detopt1zIIUhBgng Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:26:27.308631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4b972cee2d99491096a0aba46391cec6", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 0b8cfb5d2a34451bb21d47bd5aae44f4 Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.309931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ebd02634-3dc0-41cf-996f-9f0d3962e44f'} Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:27.310639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.311792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.313813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Returning 404 to user: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:27.313813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-20ce895d-a3de-45c0-ab1c-28338b0e90f1 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 404 len: 111 microversion: 2.1 time: 0.033482 Sep 02 21:26:27.313813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 123/295] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:26:27 2022] DELETE /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:26:27.322648 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.323334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] [instance: ebd02634-3dc0-41cf-996f-9f0d3962e44f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.323716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.330502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.331698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.332146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.332547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-59b97a89-7a54-4046-aa4b-b7efce02bd5f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.169668 Sep 02 21:26:27.332857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.333128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 173/296] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:27.333339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.333763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.349435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] HTTP exception thrown: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Request method failure captured: Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f HTTP/1.1 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSNIMr73rT0BlqRNqTfM8AmhEcR7k9i0GfFUPtpyvr5dr21zpcpeVZNKnkRQMbz5tsLelcc32TMuhFqOPVy3myKvAI5t1fKer7KrwiuyAytTPGTX7iLT-ZlRG1O11AugwwqLPRnH3MUESlyhg3ABxbtqFqdDT5Detopt1zIIUhBgng Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:26:27.351076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b972cee2d99491096a0aba46391cec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4b972cee2d99491096a0aba46391cec6", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 4b972cee2d99491096a0aba46391cec6 Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752822332 Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 0b8cfb5d2a34451bb21d47bd5aae44f4 Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1752822332-project Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.358307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ebd02634-3dc0-41cf-996f-9f0d3962e44f'} Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:27.359194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. Sep 02 21:26:27.360295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.362710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] Returning 404 to user: Instance ebd02634-3dc0-41cf-996f-9f0d3962e44f could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:27.362710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fea04f42-4d42-44f5-abe3-13c47a8ea3a4 tempest-DeleteServersTestJSON-1752822332 tempest-DeleteServersTestJSON-1752822332-project] 10.222.0.99 "GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f" status: 404 len: 111 microversion: 2.1 time: 0.037279 Sep 02 21:26:27.362710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 124/297] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/ebd02634-3dc0-41cf-996f-9f0d3962e44f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:26:28.356358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:28.356963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:28.363945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.364450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.364888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.366280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.366981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.367550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.668460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:28.677365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f5a6b9b1-a08d-4f41-9b06-293d38346b62 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.324736 Sep 02 21:26:28.684903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 174/298] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:28 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:29.701952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:29.703345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:29.713300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.715524 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.716173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.718452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.719127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.720229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.975566 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:29.984495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1fe977e1-72ca-4d91-ba16-836510553017 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.286356 Sep 02 21:26:30.001607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 125/299] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:29 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:31.008815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.009573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.020366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.021029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.021484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.022455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.022922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.023592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.030638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:31.177427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.188287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-15944a22-3b6e-43e6-940e-e6f9427ab2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.184257 Sep 02 21:26:31.190383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 175/300] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:32.214920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:32.216573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:32.224998 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.225520 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.226164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.227109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.227579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.228016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.579766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:32.589050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e5b80886-790a-4956-9096-29cc92766095 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.378207 Sep 02 21:26:32.589643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 126/301] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:32 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:33.615084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:33.616743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:33.632101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.644234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.644234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.644234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.644234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.644528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.839349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.851433 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a636524-1f2e-4d63-9428-45c9340ca999 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.242459 Sep 02 21:26:33.852128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 176/302] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:33 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:34.875749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.876352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.883258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.883775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.884209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.884898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.885481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.885794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.029802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.038597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8eb5e6ef-6a32-4f66-ae14-10b2e2f16469 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.166878 Sep 02 21:26:35.039175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 127/303] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:36.062369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:36.071096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:36.079401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.084739 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.085205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.085994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.086469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.086904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.313651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:36.321923 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-07ee2af0-d83c-4e82-8fd7-e1efd303610d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.263961 Sep 02 21:26:36.322793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 177/304] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:36 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:37.347141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:37.347790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:37.354468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.354969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.355414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.356123 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.356587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.357041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.648056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.655538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4e9c688-44a5-421d-83e1-34a626fd0777 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.312261 Sep 02 21:26:37.656121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 128/305] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:37 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:38.680116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:38.681604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.688016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.688514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.689088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.689834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.690523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.691421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.862839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.872383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a3a20536-7769-4b96-bf9b-89b47e9fa4bc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1503 microversion: 2.1 time: 0.196928 Sep 02 21:26:38.873005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 178/306] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:38 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:38.896499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac24a941-eb01-4ac7-8724-29b6a14bc85a"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:38.898860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.905226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.905628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.906098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.906795 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.907245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.907676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.933579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] HTTP exception thrown: Cannot 'attach_volume' instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 while it is in vm_state rescued Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Request method failure captured: Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/os-volume_attachments HTTP/1.1 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 74 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRpvEcdPnGtprDf5fO7SZYQkmKMkufJPNA5HvOGKgMUGPHY_jUNscYa1CTrrjnk8XAtzr43uE_WGTXyRKE_lXJCTVxN-dZh9Hp5Qx0sjHvJ2VvBZV2BJ3bZXlysQ71apox1y6RMxV1WB48xGDtQUSMcysCJcSbnx6YAaXzvrKwEdM Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 786534cce098405196143139d375b465 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:26:38.935465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/786534cce098405196143139d375b465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_786534cce098405196143139d375b465", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 786534cce098405196143139d375b465 Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: dc0bc75b6b3f4d1689bc1f7faaa2e5bc Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {"volumeAttachment": {"volumeId": "ac24a941-eb01-4ac7-8724-29b6a14bc85a"}} Sep 02 21:26:38.937565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Cannot 'attach_volume' instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 while it is in vm_state rescued Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'server_id': '6bf9bb41-be89-4802-ba81-6eb3fa5ebb68', 'body': {'volumeAttachment': {'volumeId': 'ac24a941-eb01-4ac7-8724-29b6a14bc85a'}}} Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:38.938534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 while it is in vm_state rescued Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:38.939872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 while it is in vm_state rescued Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Returning 409 to user: Cannot 'attach_volume' instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 while it is in vm_state rescued {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3b4984e4-5250-4a00-bf1c-9e746a416dec tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045020 Sep 02 21:26:38.942134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 129/307] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:26:38 2022] POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 21:26:38.951635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:38.952175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.959292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.959920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.960368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.961079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.961540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.962015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.268611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-22702d6d-308a-431f-901b-d6374c3ddeda tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/action" status: 202 len: 0 microversion: 2.1 time: 0.320660 Sep 02 21:26:39.270408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 179/308] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:26:38 2022] POST /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:26:39.280919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:39.281940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:39.288487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.288984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.289495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.290573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.291204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.291645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.503857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:39.512451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3b050fbd-0917-46e7-8c68-dedf6846a98d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1511 microversion: 2.1 time: 0.235394 Sep 02 21:26:39.513393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 130/309] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:39 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:40.538207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:40.539033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:40.549274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.549974 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.550805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.551857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.552433 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.554158 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.773415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:40.787329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-15ca4e48-b9b0-4e19-9b67-988acf98628d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1511 microversion: 2.1 time: 0.250047 Sep 02 21:26:40.787329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 180/310] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:40 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:41.808151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:41.808770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:41.822693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.826666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.827231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.828571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.828571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.828882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.887275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:42.063942 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.072761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-00c86146-09ff-4145-94a3-5d98d20add20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1511 microversion: 2.1 time: 0.268398 Sep 02 21:26:42.073349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 131/311] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:41 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:43.096888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:43.098255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:43.106830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.107795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.109346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.110153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.110920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.111362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.406068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:43.418078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-169afe94-41ce-4cfc-b247-62faaf1ecd6e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1511 microversion: 2.1 time: 0.324986 Sep 02 21:26:43.419065 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 181/312] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:43 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:44.445355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:44.446765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:44.455611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.456969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.457824 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.458894 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.459565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.460063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.668326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.679235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8990f978-4561-45e1-bfb2-df86b1592e50 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1517 microversion: 2.1 time: 0.238780 Sep 02 21:26:44.679825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 132/313] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:44 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:46.084540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a21b4c0d-a8a3-46ed-9c75-b89182f74a27 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: .version_select at 0x7faac0c8c670>, body: {"keypair": {"name": "tempest-keypair-224085382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpzxL3G9aflQtzHrmYL0Mt8rboYQ+nLxbhbbuaifpK3TQSb6QFE4Dh2z6LdIP/VVI/S1EIU0V3FO07yV/FtJUfKlIjsHTWrKBzC+LTPDZ7MCjmyc29S6bPW24U9x9sY7g=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:46.103351 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-a21b4c0d-a8a3-46ed-9c75-b89182f74a27 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:46.107370 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-a21b4c0d-a8a3-46ed-9c75-b89182f74a27 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:46.442873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a21b4c0d-a8a3-46ed-9c75-b89182f74a27 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.475521 Sep 02 21:26:46.443473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 182/314] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:26:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:49.634976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1937777883", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "315bf927-f303-4323-bf17-32171d1e63b8"}], "security_groups": [{"name": "tempest-securitygroup--2137974379"}], "key_name": "tempest-keypair-224085382", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:49.750617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] validate_networks() for [('315bf927-f303-4323-bf17-32171d1e63b8', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:26:49.977075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=38 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:50.187860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:26:50.188283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:26:50.188756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:26:50.189285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:26:50.189285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:26:50.211668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.212162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.212620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.213366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.213897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.214481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.233847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:50.238616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:50.254549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:26:50.257247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:26:50.411723 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9a58eb51-1b60-4ec6-a476-8a7604846943 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781639 Sep 02 21:26:50.412665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 133/315] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:26:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:26:50.424083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-416beeea-f5b4-4373-9e3a-5bf52bd7d2d4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:50.424818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-416beeea-f5b4-4373-9e3a-5bf52bd7d2d4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:50.494197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-416beeea-f5b4-4373-9e3a-5bf52bd7d2d4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.501619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-416beeea-f5b4-4373-9e3a-5bf52bd7d2d4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1241 microversion: 2.1 time: 0.081548 Sep 02 21:26:50.502231 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 183/316] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:50 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:51.529935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-60cd9f21-73e8-4ab3-b195-147f16f3fb6c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:51.530487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-60cd9f21-73e8-4ab3-b195-147f16f3fb6c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:51.599028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-60cd9f21-73e8-4ab3-b195-147f16f3fb6c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:51.607994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-60cd9f21-73e8-4ab3-b195-147f16f3fb6c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1241 microversion: 2.1 time: 0.083673 Sep 02 21:26:51.608587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 134/317] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:51 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:52.038847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-445a4220-0939-4c06-859d-3e88860da0b5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: .version_select at 0x7faac0c89310>, body: {"keypair": {"name": "tempest-keypair-609335787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMab3Fa35GaKR/QFuSW6eGIWroHDEB8QfVWOjrUK0EZoFFPVIwQS4G1aDdTIzo/TpEaBz3OvAD1/mEQbu3QoZunCwaFE/Mu0QjorYZPXW1qxAsGDS1dDbQ1iiwW3X4W+A=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:52.058468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-445a4220-0939-4c06-859d-3e88860da0b5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for project 786534cce098405196143139d375b465. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:52.062427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-445a4220-0939-4c06-859d-3e88860da0b5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for user dc0bc75b6b3f4d1689bc1f7faaa2e5bc and project 786534cce098405196143139d375b465. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:52.192243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-445a4220-0939-4c06-859d-3e88860da0b5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156473 Sep 02 21:26:52.193227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 184/318] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:26:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:52.632622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:52.633240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:52.642292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.642788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.650455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:52.650455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.650455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.650455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:52.734911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:52.755060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-525c922c-26da-432e-a5ab-b20882893930 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1293 microversion: 2.1 time: 0.127345 Sep 02 21:26:52.755678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 135/319] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:52 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:53.786621 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:53.787941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:53.791939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:53.795565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.796061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.796501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.797247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.797662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.798116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.864346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.872015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6fa2d4d4-76ca-4be2-b709-e41270108fc0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1301 microversion: 2.1 time: 0.091216 Sep 02 21:26:53.872586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 185/320] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:53 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:54.898527 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:54.899352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:54.906494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.922344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.923312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.924185 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.924913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.925490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.079734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:55.088408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4e31264c-9ffd-452e-8de5-6f9b4cb14863 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.195453 Sep 02 21:26:55.088990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 136/321] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:54 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:55.501455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1726664327", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa27b18d-d540-49c4-ac05-71fff90bf993"}], "security_groups": [{"name": "tempest-securitygroup--2009324076"}], "key_name": "tempest-keypair-609335787", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:55.542795 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a53988-5e75-44d2-9cb2-6f5c31e2144d", "tag": "d6ba7825-9b7b-4865-a1dd-8cb3cb034b49"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:55.554814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.558782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.559595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.588438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] Creating event network-changed:d6ba7825-9b7b-4865-a1dd-8cb3cb034b49 for instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d on hv-cinder-85221 Sep 02 21:26:55.612092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-518e540b-6ec3-4047-a1ed-6664f0fe22bc req-c0b2b99a-f0ea-4b8e-b1d3-ea02f3195b57 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061126 Sep 02 21:26:55.615603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 137/322] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:26:55.677570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] validate_networks() for [('fa27b18d-d540-49c4-ac05-71fff90bf993', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:26:56.118340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:56.126781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:56.135986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.136482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.137179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.138096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.139045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.139635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.285595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:26:56.287073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:26:56.303249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:26:56.303598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:26:56.304069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:26:56.328049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.328547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.330791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.330791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.330791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.330791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.362052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.365106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:56.371129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Getting quotas for user dc0bc75b6b3f4d1689bc1f7faaa2e5bc and project 786534cce098405196143139d375b465. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:56.371637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8fadb2f8-668d-4fb5-bf5e-3c40dc3cca95 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.258700 Sep 02 21:26:56.387880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:26:56.389559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:26:56.391750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 138/323] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:56 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:56.635154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-70537b12-a569-415f-b417-80c20e94a108 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.137937 Sep 02 21:26:56.636436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 186/324] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:26:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:26:56.649339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f164e39-8b2e-437b-a2f7-191418989167 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:56.650604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f164e39-8b2e-437b-a2f7-191418989167 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:56.764628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f164e39-8b2e-437b-a2f7-191418989167 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.774815 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f164e39-8b2e-437b-a2f7-191418989167 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1245 microversion: 2.1 time: 0.130184 Sep 02 21:26:56.775412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 139/325] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:56 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:57.395699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:57.396325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:57.398541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=5 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:57.403808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.404353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.404972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.405845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.406470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.406910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.805315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:57.806037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:57.817523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.819002 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.819732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.820540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.821079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.821622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.870033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.878095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a4a152ca-1d8a-4f4c-a01a-62c95e3a6b6f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.486348 Sep 02 21:26:57.879193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 187/326] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:57 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:57.922911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.931881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e3bfe406-31c3-468e-bfd6-ad1ddee411d0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.132765 Sep 02 21:26:57.946222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 140/327] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:57 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:58.900952 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.902315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.908716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.909199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.909638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.910568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.911033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.911460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.955888 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.956504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.965041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.965851 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.966471 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.967184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.967671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.968101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:59.048286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.057802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a571c00a-f60b-4a88-8b31-3505c06008d4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.106543 Sep 02 21:26:59.058388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 141/328] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:59.129510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.138144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-de64b8d2-b357-4f12-aebf-fb1f645d98a7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.241365 Sep 02 21:26:59.138922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 188/329] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:00.083086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:00.083701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:00.091186 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.091678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.092121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.092840 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.093336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.093846 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.162424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:00.163033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:00.169365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.169499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.169803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.170238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.170935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.171385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.171810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.184994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-237fe24f-1be1-44e6-bcb6-0296aaf67355 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.106594 Sep 02 21:27:00.190357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 142/330] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:00 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:00.319598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.327512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5fdc7b38-b876-4085-ad34-c3768828eba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.169896 Sep 02 21:27:00.328082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 189/331] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:00 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:01.209061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:01.209577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:01.211552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:01.216995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.217524 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.218035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.218749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.219215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.219653 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.287230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.295110 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-27645b8a-4a2e-417f-b1da-1e9e43c12792 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.090554 Sep 02 21:27:01.295691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 143/332] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:01 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:01.359536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:01.360151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:01.366534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.367013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.367445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.368139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.368586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.369009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.506926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.514911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-222ed232-cdfb-4397-bd60-1bb2d6f70b51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.159189 Sep 02 21:27:01.515481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 190/333] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:01 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:02.320322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:02.320931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:02.327627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.328114 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.328542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.329227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.329680 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.330930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.413662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:02.421440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5bb3992b-7a48-4edb-b9c3-9c46380f5d20 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.104926 Sep 02 21:27:02.421976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 144/334] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:02 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:02.538891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:02.539633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:02.545744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.546237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.546666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.547353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.547847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.548229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.680228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:02.687912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2fffe5c3-1401-483f-8337-f10d1c8def51 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.153509 Sep 02 21:27:02.688491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 191/335] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:02 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:03.445374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:03.446058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:03.452743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.453225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.453662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.454451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.454901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.455339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.520689 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:03.529191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-beecf075-78e8-4111-bee2-d3f787d4f4aa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.088538 Sep 02 21:27:03.529777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 145/336] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:03 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:03.711398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:03.712014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:03.718336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.718822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.719250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.720025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.720565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.721094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.852933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:03.860756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a393be1f-d44e-4c5f-be1a-e8b8294a4085 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.153512 Sep 02 21:27:03.861326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 192/337] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:03 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:04.552244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:04.552956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:04.559296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.559775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.560215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.561085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.561549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.562005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.624206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:04.632654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-07eb3911-f11b-428e-b432-c9b11068a35f tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1249 microversion: 2.1 time: 0.084356 Sep 02 21:27:04.633225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 146/338] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:04 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:04.884449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:04.885065 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:04.891592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.892082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.892511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.893205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.893654 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.894105 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:05.037904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.045950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-98106e8e-ee13-4603-8721-facfe7047222 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.165816 Sep 02 21:27:05.046792 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 193/339] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:04 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:05.657357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:05.658150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:05.665345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:05.665919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:05.666359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:05.667053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:05.667506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:05.667931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:05.733051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.741222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3b069770-50df-42c4-b583-41fea4f9c3f5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1297 microversion: 2.1 time: 0.087944 Sep 02 21:27:05.741809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 147/340] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:05 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:06.068799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:06.069476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:06.075808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.076298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.076737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.077473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.077958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.078448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.104444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-386499645", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "networks": [{"uuid": "be8a17af-8679-4036-958b-5fe5d43385a0"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:06.175051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] validate_networks() for [('be8a17af-8679-4036-958b-5fe5d43385a0', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:27:06.288423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:06.300552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6585d839-9431-4e9f-9d68-4791202be9ad tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.235101 Sep 02 21:27:06.309868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 194/341] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:06 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:06.627612 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:27:06.628127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:27:06.628684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:27:06.629215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:27:06.629673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:27:06.643810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.644634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.645365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.646594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.647601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.648244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.676951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Getting quotas for project cbffdee4dc4341e4a33fcfe884f28072. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:27:06.686169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Getting quotas for user 50dab514c64d47d095bd6d1ac8ce3b56 and project cbffdee4dc4341e4a33fcfe884f28072. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:27:06.702993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:27:06.705461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:27:06.736102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-458822068", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "networks": [{"uuid": "f0fb4dc6-8410-4ed7-b8c0-f2bf9fe5fa85"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:06.749399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:06.750180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=16 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:06.795241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] validate_networks() for [('f0fb4dc6-8410-4ed7-b8c0-f2bf9fe5fa85', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:27:06.991416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-402206d4-e8a1-4feb-833d-725894c7cec9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890591 Sep 02 21:27:06.993673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 148/342] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:27:07.012879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:07.013529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:07.029572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.030413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.031027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.031909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.032530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.033116 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.137226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.148851 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-efd0dbde-9d6a-48d1-99e5-d887c561f59b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1305 microversion: 2.1 time: 0.153831 Sep 02 21:27:07.150037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 149/343] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:06 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:07.164314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-53bfc499-d6ae-4b9c-8ff3-2e3d13ede661 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:07.165968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-53bfc499-d6ae-4b9c-8ff3-2e3d13ede661 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:07.294937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-53bfc499-d6ae-4b9c-8ff3-2e3d13ede661 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.304079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-53bfc499-d6ae-4b9c-8ff3-2e3d13ede661 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1218 microversion: 2.1 time: 0.152539 Sep 02 21:27:07.304666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 150/344] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:07 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:07.347268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:07.348336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:07.380529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.382660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.383340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.383461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:27:07.385511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.386390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.387093 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.387659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:27:07.388216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:27:07.390833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:27:07.391280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:27:07.409442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.409986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.410432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.411168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.411769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.412768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.449916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Getting quotas for project 86ad1eb80d2a42c9871f992a85b27a17. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:27:07.458864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Getting quotas for user 7c0b3d9264174863b78e100a659e90bf and project 86ad1eb80d2a42c9871f992a85b27a17. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:27:07.477919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:27:07.480539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:27:07.598124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.606738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2bd74c74-6f3b-46b1-930e-d3643500dd4e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.281802 Sep 02 21:27:07.607436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 151/345] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:07 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:07.612238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a53988-5e75-44d2-9cb2-6f5c31e2144d", "name": "network-vif-plugged", "status": "completed", "tag": "d6ba7825-9b7b-4865-a1dd-8cb3cb034b49"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:07.625013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.625611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.626100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.638350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] Creating event network-vif-plugged:d6ba7825-9b7b-4865-a1dd-8cb3cb034b49 for instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d on hv-cinder-85221 Sep 02 21:27:07.643691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0e8ffd6b-99a2-479b-9f08-62743dfd5295 req-756830c5-a907-4039-9e7b-e53d930a2358 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035083 Sep 02 21:27:07.644286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 152/346] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:08.085362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-84b0f9fc-2645-43d5-af17-c37125229984 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353007 Sep 02 21:27:08.086049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 195/347] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:27:08.098350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-17e3140a-5e4f-45fb-a6bb-0d8a071844c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.099055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-17e3140a-5e4f-45fb-a6bb-0d8a071844c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.180647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-17e3140a-5e4f-45fb-a6bb-0d8a071844c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.180784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.180784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.190298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.191014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.191633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.192510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.194088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.194709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.195500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-17e3140a-5e4f-45fb-a6bb-0d8a071844c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1213 microversion: 2.1 time: 0.101868 Sep 02 21:27:08.198144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 153/348] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:08.328534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-59e2b13d-81f2-4c79-a43f-724e6a465bdf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.329132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-59e2b13d-81f2-4c79-a43f-724e6a465bdf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.465957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-59e2b13d-81f2-4c79-a43f-724e6a465bdf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.477426 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-59e2b13d-81f2-4c79-a43f-724e6a465bdf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1218 microversion: 2.1 time: 0.153799 Sep 02 21:27:08.489861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 154/349] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:08.510458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.520769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fa4208cf-4781-4377-bae7-e3f201b4078a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.346704 Sep 02 21:27:08.537902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 196/350] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:08.630569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.631518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.638204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.638697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.639139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.640175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.640684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.641115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.660273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:08.842819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.851868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e5ec3d15-427b-4b06-9fef-b38c441886e1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.225144 Sep 02 21:27:08.852457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 155/351] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:09.220343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-00d14425-50a3-47a4-a7ea-da3a47d61b11 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.220947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-00d14425-50a3-47a4-a7ea-da3a47d61b11 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.273739 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-00d14425-50a3-47a4-a7ea-da3a47d61b11 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.280598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-00d14425-50a3-47a4-a7ea-da3a47d61b11 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1213 microversion: 2.1 time: 0.064161 Sep 02 21:27:09.288930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 197/352] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:09.303619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:09.314098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.314642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.315056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.326210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] Creating event network-changed:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:27:09.331123 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-06e9b87a-2d1b-42f6-90a1-d154c4652284 req-b9dcd3ae-64e1-4740-8076-00b5e786cc56 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032115 Sep 02 21:27:09.331880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 156/353] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:09.503011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.503649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.509686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.510203 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.510645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.511342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.511801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.512239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.549066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.549765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.556224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.556712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.557150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.557877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.558339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.558891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.578564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.587664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-df7c1acc-a28a-4835-ae6c-bc8c10fac2c3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1222 microversion: 2.1 time: 0.088516 Sep 02 21:27:09.588279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 198/354] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:09.708726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.717548 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-662f324c-300e-46de-ab5c-e9fa5cafd11c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.172840 Sep 02 21:27:09.718147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 157/355] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:09.875411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.876137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.882864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.884572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.884572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.884572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.884890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.885276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.018378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.027073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da4f5f4d-9e48-473e-ad51-3e354a2a1ef1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1367 microversion: 2.1 time: 0.155525 Sep 02 21:27:10.033199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 199/356] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:10.306926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.307472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.314177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.314691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.315173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.315865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.316321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.316756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.385934 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.394292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-81cfc399-993f-4715-9389-1f61148e3961 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1217 microversion: 2.1 time: 0.092707 Sep 02 21:27:10.395434 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 158/357] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:10.612419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.613071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.620502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.620990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.621426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.622165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.622621 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.623046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.686579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.694417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-03f19dc5-9702-497c-8d06-cb9effe72754 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1222 microversion: 2.1 time: 0.086018 Sep 02 21:27:10.695423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 200/358] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:10.741558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.742206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.748273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.748754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.749268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.749973 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.750421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.753552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.883518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.891478 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d4385623-b620-4269-aedf-a79e637c0c84 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.154719 Sep 02 21:27:10.892046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 159/359] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:11.050013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.050642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.056997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.061538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.061538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.061538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.061538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.062147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.207870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.216036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-566f1ed3-9e4c-401d-a9f7-e68611e8d5fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1556 microversion: 2.1 time: 0.170084 Sep 02 21:27:11.216604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 201/360] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:11.248773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.249277 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.260564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.263610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.263610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.263610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.263610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.264210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.347010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-10284daf-ba6c-4968-892f-a91b7845369d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106422 Sep 02 21:27:11.355884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 160/361] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:11.417505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.418501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.425005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.426180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.427215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.428245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.429059 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.429740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.546464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.556891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8204d483-b4ac-48ac-92de-6301ef41217b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1209 microversion: 2.1 time: 0.142901 Sep 02 21:27:11.558089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 202/362] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:11.717793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.718420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.724402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.725796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.726439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.727153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.727613 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.728046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.821999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.830051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-32b81c24-6464-496f-b916-ff8d49bc87e0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.116099 Sep 02 21:27:11.830633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 161/363] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:11.915801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.916343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.922532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.922977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.923471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.924184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.924647 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.925075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.102736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.106246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:12.111012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0b9e107e-4a88-45cc-b09a-104eb8a84e63 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.199967 Sep 02 21:27:12.111580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 203/364] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:12.581300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.581959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.588875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.589400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.589881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.590764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.591398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.591820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.668913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.676918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0cfdf414-719c-4a3b-93a6-6d5bbc286b77 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1265 microversion: 2.1 time: 0.099778 Sep 02 21:27:12.677677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 162/365] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:12.770127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a53988-5e75-44d2-9cb2-6f5c31e2144d", "tag": "d6ba7825-9b7b-4865-a1dd-8cb3cb034b49"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:12.780319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.780799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.781474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.795539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] Creating event network-changed:d6ba7825-9b7b-4865-a1dd-8cb3cb034b49 for instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d on hv-cinder-85221 Sep 02 21:27:12.800762 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-79f70d10-1a2e-4647-92da-1a12b0690fa3 req-ee599cc0-d09a-4f26-9f76-dc04aeafb427 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034180 Sep 02 21:27:12.801531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 204/366] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:12.861116 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.861756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.868738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.869231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.870005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.870901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.871361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.871924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.937073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.945284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-318aa830-25e0-4565-9ed9-3e3d176bcb3d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.087993 Sep 02 21:27:12.945897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 163/367] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:13.136146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.136985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.143566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.144053 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.144539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.145237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.145694 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.146172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.299595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.308299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c03b4372-3d65-457b-8f6f-e89689c6e86d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.177019 Sep 02 21:27:13.324926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 205/368] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:13.701281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.701937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.705007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:13.710788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.711287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.711731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.712435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.712955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.713384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.780280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.796438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-925d3b63-60b7-4d3b-9700-a1df19fdc311 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1265 microversion: 2.1 time: 0.092136 Sep 02 21:27:13.796438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 164/369] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:13.969152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.969901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.976265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.976841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.977369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.978239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.978767 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.979269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.068058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:14.076061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-43bc6c46-2cf5-4824-b27f-ea3327cf8cc4 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.111819 Sep 02 21:27:14.076588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 206/370] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:14.332408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:14.333025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:14.340673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.341159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.341601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.342333 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.342790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.343216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.479890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:14.488162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4b3b1949-8ca4-4396-8ff9-ce0faed7e5dc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.159915 Sep 02 21:27:14.488767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 165/371] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:14 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:14.813163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:14.813798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:14.820935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.821420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.821884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.822656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.823107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.823527 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.906141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:14.914991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fe019f09-b4d5-46f7-a6a1-47e66604ea71 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1265 microversion: 2.1 time: 0.104702 Sep 02 21:27:14.915607 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 207/372] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:14 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:15.101188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:15.103365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:15.109864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.110571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.111006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.111695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.112148 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.112568 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.177988 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:15.187182 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-81c41539-6bb5-4954-9e7c-06ed628a14e9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.090636 Sep 02 21:27:15.187785 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 166/373] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:15 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:15.511680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:15.512289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:15.518646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.519071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.519508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.520225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.520773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.521197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.666962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:15.674752 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1cdfb3d6-6015-497c-b3b6-7c6782a4d488 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.167094 Sep 02 21:27:15.675332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 208/374] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:15 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:15.937626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:15.938487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:15.944405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.944891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.945944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.946803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.947263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.947768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.011051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.018995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-71e1c387-a41f-44e5-b6f9-e88ef5d83e9c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1265 microversion: 2.1 time: 0.085373 Sep 02 21:27:16.019562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 167/375] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:15 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:16.211187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:16.211953 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:16.218971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.219502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.219937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.220635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.221094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.221523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.300207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.309935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5e36295e-af33-4bcb-a077-6cc1e23fee71 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.102886 Sep 02 21:27:16.310895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 209/376] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:16 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:16.697954 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:16.698617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:16.701597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.706878 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.707379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.707823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.708539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.708996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.709429 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.845760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.854792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b655d5ba-c57b-403b-bbc3-6887288715e0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.160704 Sep 02 21:27:16.858676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 168/377] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:16 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:17.043382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:17.043943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:17.050050 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.050541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.050982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.051681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.052145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.052576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.117751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:17.125419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-00b73495-2da3-4879-b568-9b7dbb642bc4 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1265 microversion: 2.1 time: 0.086892 Sep 02 21:27:17.126016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 210/378] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:17 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:17.340763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:17.341697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:17.349281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.349808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.350718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.351440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.351905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.352351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.425689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "name": "network-vif-plugged", "status": "completed", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:17.438093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:17.440717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.441262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.441924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.456461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] Creating event network-vif-plugged:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:27:17.459216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:17.463778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-cc383b44-e59c-4fc3-8dca-8499e5a8b875 req-c82417cc-e384-4df4-8767-eb7b6d421174 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041779 Sep 02 21:27:17.466062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 211/379] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:17.482500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52234fe5-0bcf-447a-ab39-2859c80f4130 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1270 microversion: 2.1 time: 0.145517 Sep 02 21:27:17.483870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 169/380] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:17 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:17.881294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:17.881294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:17.887845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.888336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.888776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.889476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.889954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.890813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.120511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:18.128644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4f3c09f4-d094-429f-a8bf-167fda323780 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.253516 Sep 02 21:27:18.129224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 212/381] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:17 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:18.150511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:18.151216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:18.158034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.158523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.158962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.159662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.160125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.160554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.233156 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:18.248921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b2c8d134-7848-449f-8766-dd67a45aae37 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1271 microversion: 2.1 time: 0.102826 Sep 02 21:27:18.250193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 170/382] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:18 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:18.507995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:18.508801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:18.516590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.517094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.517650 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.518255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.518720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.519146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.621665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:18.631361 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7c1fffb4-91f1-4efa-889b-921e9730ef80 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1288 microversion: 2.1 time: 0.127721 Sep 02 21:27:18.637936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 213/383] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:18 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1288 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:19.154148 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:19.154834 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:19.156721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=22 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:19.162056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.162526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.162972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.163854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.164155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.164585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.274970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:19.275567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:19.277536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=8 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:19.283554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.284589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.284589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.285290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.285768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.286215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.469796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:19.487320 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-35fefded-ea29-4e4f-8d57-6c9af17d99d2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1371 microversion: 2.1 time: 0.336810 Sep 02 21:27:19.488995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 171/384] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:19 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:19.564260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:19.573422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a9595881-26ec-42bd-93dd-dec8436625c0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.302978 Sep 02 21:27:19.574394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 214/385] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:19 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:19.657581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:19.658530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:19.664579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.665120 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.666206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.666953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.667411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.667939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.778545 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6298d2a-d68f-486b-8701-cc07b3fbd52c", "tag": "74d8fdea-9f7c-4208-91b5-528c53a6aa84"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:19.792275 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.792541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.793121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.817128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] Creating event network-changed:74d8fdea-9f7c-4208-91b5-528c53a6aa84 for instance a6298d2a-d68f-486b-8701-cc07b3fbd52c on hv-cinder-85221 Sep 02 21:27:19.824624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-b6eb6f9b-c835-4898-a05c-a47087c1fb58 req-6c9123c8-6a56-49b7-a074-bded6783b919 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057229 Sep 02 21:27:19.825234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 215/386] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:19.880870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:19.889882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-552baddb-05c6-4fb3-a605-38128312885d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.236272 Sep 02 21:27:19.890947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 172/387] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:19 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:20.395177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a658e9d-9680-4d98-9d62-928ea9eaed1c", "tag": "35fb5adf-342b-472e-9def-e585978bdf8b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:20.406017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.406504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.406936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.420298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] Creating event network-changed:35fb5adf-342b-472e-9def-e585978bdf8b for instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c on hv-cinder-85221 Sep 02 21:27:20.425467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-82dcf9c2-2f4e-4bcf-87d8-8c279a0152ab req-9801468c-b8a8-4861-87b3-c6fb75d9b58d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Sep 02 21:27:20.426407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 216/388] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:20.512074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.512699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.519646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.520139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.520592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.521292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.521765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.522195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.527257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:20.606727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.607589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.615140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.615728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.616233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.616998 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.617666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.618318 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.732331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:20.740312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c794c7d4-4af2-4b68-b381-7587f8de1eac tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1566 microversion: 2.1 time: 0.232020 Sep 02 21:27:20.741536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 173/389] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:20.768186 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.771261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.779188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.781756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.781756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.781756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.782076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.782330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.920013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:20.930133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-997b9148-1c8e-4ee1-9361-11096a4d9304 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.329039 Sep 02 21:27:20.931184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 217/390] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:20.941970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.942898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.952365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.953208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.953737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.954669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.955196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.955913 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:21.004556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b6f4a663-514e-4eb6-8446-bbb6003fb76c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240872 Sep 02 21:27:21.014460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 174/391] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:21.569514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:21.582802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5a4b57d5-c0ab-4240-bcde-1afbcc34098b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.650114 Sep 02 21:27:21.584517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 218/392] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:21.955393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:21.956731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:21.964235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:21.965010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:21.965617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:21.966570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:21.967194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:21.967780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.214106 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:22.227378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fd88224e-7e10-4e3a-8eec-fae06a1b7c1a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.277878 Sep 02 21:27:22.228770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 175/393] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:21 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:22.615649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:22.616250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:22.626338 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.626924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.627390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.628136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.628620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.629045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.790988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:22.800408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4b7439f9-33c8-4d50-b691-27904d058d03 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.188469 Sep 02 21:27:22.813269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 219/394] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:22 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:22.893531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:22.906818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.907294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.907721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.926911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] Creating event network-changed:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:27:22.928565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c25d7020-cda5-4109-9a9e-70f8e833cdb1 req-f969adb1-909d-4a89-ac7b-37bd083abf86 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040394 Sep 02 21:27:22.929974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 176/395] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:23.251892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:23.252529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:23.258905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.259293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.259733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.260510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.260971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.261401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.413317 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:23.422460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9da373f1-414b-4152-a33a-60ca65794c70 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.174607 Sep 02 21:27:23.423041 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 220/396] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:23 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:23.829424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:23.830177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:23.837244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.841567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.841567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.841567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.841567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.842071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.997259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:24.005422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-49d74a99-bebd-4bc8-b2cf-2cd191b76c3b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.184701 Sep 02 21:27:24.006577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 177/397] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:23 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:24.446182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:24.446826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:24.453699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.454212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.454653 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.455357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.455817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.456246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.598514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:24.610760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-85552424-715c-45ce-97fe-f515f19537bf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.168103 Sep 02 21:27:24.613450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 221/398] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:24 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:25.028875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:25.029599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:25.037488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.038010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.038455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.039169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.039627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.040058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.178676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:25.187361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-992abec9-3de7-4ad4-90f7-86cf4b68917c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.162590 Sep 02 21:27:25.187921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 178/399] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:25 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:25.647555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:25.648306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:25.655093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.655594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.656031 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.656737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.657197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.657624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.846193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:25.857186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d73c94d7-b8d7-4b16-9d5b-6343af0f6a39 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.212926 Sep 02 21:27:25.857988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 222/400] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:25 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:26.211267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:26.211827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:26.218850 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.219393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.219828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.220512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.221010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.221431 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.355603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:26.363540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7d4f8398-861d-406e-8376-b316d8cc5e0b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.156217 Sep 02 21:27:26.364105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 179/401] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:26 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:26.880580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:26.881194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:26.887287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.895609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.895609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.895609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.895609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.896064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.896064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:27.025630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:27.039262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9d6bcb62-f9a1-4ac4-93fa-61ebdc50ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.158127 Sep 02 21:27:27.039262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 223/402] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:26 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:27.387187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:27.387820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:27.394682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:27.395164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:27.395605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:27.396378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:27.396839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:27.397267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:27.530931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:27.538681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e8f360f-c418-444b-a88d-c2882fb2be25 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.155811 Sep 02 21:27:27.539247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 180/403] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:27 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:28.060575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:28.061194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:28.067337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.067820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.068260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.068962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.069419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.069884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.201276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:28.216030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9ab129d2-438a-4cfb-800f-433f862eec4b tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.152135 Sep 02 21:27:28.216030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 224/404] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:28 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:28.562681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:28.563289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:28.569986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.570581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.570915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.571617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.572821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.573809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.667187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6298d2a-d68f-486b-8701-cc07b3fbd52c", "name": "network-vif-plugged", "status": "completed", "tag": "74d8fdea-9f7c-4208-91b5-528c53a6aa84"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:28.677111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.677598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.678061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.689859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] Creating event network-vif-plugged:74d8fdea-9f7c-4208-91b5-528c53a6aa84 for instance a6298d2a-d68f-486b-8701-cc07b3fbd52c on hv-cinder-85221 Sep 02 21:27:28.696403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-5eeb41a3-8f64-47d7-aee1-ae6fb6dab93d req-733dd5e9-be64-4cef-822b-24f3a7887dde service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Sep 02 21:27:28.696403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 225/405] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:28.720991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:28.729161 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7bd25a5d-e923-4b8e-89b1-94814c51b72e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.170446 Sep 02 21:27:28.729762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 181/406] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:28 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:29.233369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:29.234218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:29.240830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.241323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.241791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.242530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.242998 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.243428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.381875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:29.390165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-096b269d-7f26-4d3b-8b02-202de1ea4049 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.160891 Sep 02 21:27:29.390747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 226/407] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:29 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:29.756951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:29.757568 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:29.764256 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.764737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.765168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.765883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.766594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.767017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.901080 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:29.908961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4479c3f6-07c2-4d26-889d-aa0cbdd304a6 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.155998 Sep 02 21:27:29.909526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 182/408] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:29 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:30.414001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:30.414784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:30.421045 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:30.422861 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.423353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.423787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.424481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.425094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.425692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.661852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:30.669828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-19f498d9-3c21-4138-9707-1e5f76d5a5cf tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.259821 Sep 02 21:27:30.670750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 227/409] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:30 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:30.933729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:30.934272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:30.940783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.941342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.941856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.942553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.943009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.943451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.080838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:31.088699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bf302c15-8324-4b2a-b134-7781abd3ff5f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.159083 Sep 02 21:27:31.089275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 183/410] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:30 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:31.693295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:31.693944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:31.700162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.700647 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.701081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.701802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.702265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.702717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.834896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:31.843394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-580b4005-3979-4c71-8512-c540a01dc1f9 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.153961 Sep 02 21:27:31.844227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 228/411] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:31 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:32.117546 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:32.118205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:32.125099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.125593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.126061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.127728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.127728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.127728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.267859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:32.275648 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f29f04d-f278-4d2a-b8cc-14df2bc4ba7c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.162232 Sep 02 21:27:32.277081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 184/412] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:32 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:32.867439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:32.868089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:32.874755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.875244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.875674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.876361 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.876811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.877230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:33.011921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:33.020853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6fa9ff9a-fb98-4856-9465-c13259cbdd56 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1313 microversion: 2.1 time: 0.157327 Sep 02 21:27:33.021591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 229/413] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:32 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:33.300289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:33.300896 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:33.307776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:33.310184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:33.310184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:33.310184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:33.310184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:33.310631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:33.446009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:33.458058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-56f5fa18-2b84-47d7-b587-4e0e5776ebe9 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.161615 Sep 02 21:27:33.458827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 185/414] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:33 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:33.673214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a658e9d-9680-4d98-9d62-928ea9eaed1c", "name": "network-vif-plugged", "status": "completed", "tag": "35fb5adf-342b-472e-9def-e585978bdf8b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:33.682987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:33.683472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:33.683910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:33.695280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] Creating event network-vif-plugged:35fb5adf-342b-472e-9def-e585978bdf8b for instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c on hv-cinder-85221 Sep 02 21:27:33.701009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-8787675a-ca89-4dd5-9451-193c7eeb5f26 req-bf58046b-ccf5-4b71-ab82-c0977cbebebe service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Sep 02 21:27:33.701596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 230/415] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:34.044766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:34.045412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:34.051684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.052178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.052624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.053449 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.053926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.054360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.197168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:34.206614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a957988b-0d2c-4d62-b5fd-15f5c543f933 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1497 microversion: 2.1 time: 0.165754 Sep 02 21:27:34.207415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 186/416] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:34 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:34.485513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:34.486434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:34.492937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.493479 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.493933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.494629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.495773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.496192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.644761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:34.653415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bff2cea5-0725-427b-b953-e2e77ef72888 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.172842 Sep 02 21:27:34.654294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 231/417] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:34 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:35.343259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:35.343765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:35.350541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.351025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.351493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.352187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.352645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.353071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.380869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:27:35.677764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:35.678335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:35.684667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.685164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.685611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.686363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.686863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.687302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.736351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7f16cb86-a3d0-4c49-8e02-c2b51b33249d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 204 len: 0 microversion: 2.1 time: 0.397189 Sep 02 21:27:35.736982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 187/418] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:27:35 2022] DELETE /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:27:35.754971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:35.755765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:35.761821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.762317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.762757 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.763457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.763916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.764344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.855262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:35.863373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-32c55a75-8ab8-4b55-8a24-1e58b176b306 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.189561 Sep 02 21:27:35.868207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 232/419] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:35 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:35.914674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:35.922483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-63c0de99-362a-4c7e-b32c-350746c96001 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1503 microversion: 2.1 time: 0.171699 Sep 02 21:27:35.923052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 188/420] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:35 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:36.886296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:36.887557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:36.894780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.895834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.896491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.902939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.903417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.904012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.947174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:36.953000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:36.963364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.964423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.964864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.965792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.966408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.967048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.983875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:37.136454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:37.147890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-058110e5-0a4d-499c-aea9-c01b111615fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.265652 Sep 02 21:27:37.161744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 233/421] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:36 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:37.172849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:37.181674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-73b895a8-f587-4923-ae2e-1cf2c2da4799 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1503 microversion: 2.1 time: 0.238463 Sep 02 21:27:37.182624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 189/422] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:36 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:38.175892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:38.176483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:38.182530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.183550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.183984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.184812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.185263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.185683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.205286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:38.205917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:38.212606 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.213016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.213446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.214299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.214751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.215177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.396229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:38.405085 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-430eaff8-a539-48ee-80ee-0edafbcbc5ee tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1318 microversion: 2.1 time: 0.233031 Sep 02 21:27:38.418157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 234/423] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:38 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:38.418486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:38.425544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0d51f94b-03af-4604-91ee-ad522f79ea1c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1503 microversion: 2.1 time: 0.224222 Sep 02 21:27:38.426192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 190/424] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:38 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:39.430236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:39.430866 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:39.437343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.437870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.438314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.439019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.439483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.439919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.448408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:39.449355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:39.459180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.459678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.460129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.460842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.461305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.461936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.710266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:39.718125 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7eeb4679-0109-4b93-89c3-414b07a85831 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1506 microversion: 2.1 time: 0.291751 Sep 02 21:27:39.721589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:39.724989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 235/425] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:39 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:39.729917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-872d5fca-9e72-4bf7-8f63-139a81d0fe9a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1503 microversion: 2.1 time: 0.285229 Sep 02 21:27:39.730502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 191/426] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:39 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:40.525435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6298d2a-d68f-486b-8701-cc07b3fbd52c", "name": "network-vif-deleted", "tag": "74d8fdea-9f7c-4208-91b5-528c53a6aa84"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:40.535828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:40.536308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:40.536741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.549495 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] Creating event network-vif-deleted:74d8fdea-9f7c-4208-91b5-528c53a6aa84 for instance a6298d2a-d68f-486b-8701-cc07b3fbd52c on hv-cinder-85221 Sep 02 21:27:40.557543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-df0930d1-8174-4d57-8ca1-ebb3cfb0bdf0 req-ff48aafa-7a16-49d7-bea5-4cd1fc79b483 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Sep 02 21:27:40.557543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 236/427] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:40.755962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:40.756583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:40.764064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:40.764559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:40.765009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.765732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:40.766204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:40.766640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.839536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:40.851733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-93add7d8-7272-4be8-a7c6-80761d3512d0 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1298 microversion: 2.1 time: 0.099565 Sep 02 21:27:40.852654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 192/428] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:40 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:41.878668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:41.879383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:41.885519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.886042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.886474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.887160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.888150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.891637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.923225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.923715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.924143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.924581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lazy-loading 'fault' on Instance uuid a6298d2a-d68f-486b-8701-cc07b3fbd52c {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:41.970932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:41.980019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c12b9c72-5b46-444b-89f4-312efcc63ebe tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 200 len: 1303 microversion: 2.1 time: 0.107574 Sep 02 21:27:41.980879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 237/429] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:41 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:43.004483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:43.004483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: a6298d2a-d68f-486b-8701-cc07b3fbd52c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:43.011009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.011500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.011941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.012716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.013183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.017159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.027673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] HTTP exception thrown: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Request method failure captured: Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c HTTP/1.1 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUkvZHmViOjWZP1NGI1bLl9xdTD1QQuWnz74KRx7CKRp-oNEd5nQuTrFqN7lTyc-mQ1LxiPG2Qq2JkNDMpotcgCfHgQBHHzzmvAt_yrOsevFtkwM6gedNJP9mIhO-Yqj0GlZvl0x6KpmFCSG_7d_Xu9RJc4gmD2_oX-JrgLOQYJRE0 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 86ad1eb80d2a42c9871f992a85b27a17 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesActionsTest-686363653 Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:27:43.029978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86ad1eb80d2a42c9871f992a85b27a17", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesActionsTest-686363653 Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 86ad1eb80d2a42c9871f992a85b27a17 Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesActionsTest-686363653 Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesActionsTest-686363653-project Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7c0b3d9264174863b78e100a659e90bf Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesActionsTest-686363653-project Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. Sep 02 21:27:43.031424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'a6298d2a-d68f-486b-8701-cc07b3fbd52c'} Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:27:43.032144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. Sep 02 21:27:43.033368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:27:43.034766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Returning 404 to user: Instance a6298d2a-d68f-486b-8701-cc07b3fbd52c could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:27:43.034766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-59f6fa8c-3c41-4373-8623-ec6c264977cc tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c" status: 404 len: 111 microversion: 2.1 time: 0.032052 Sep 02 21:27:43.034766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 193/430] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:42 2022] GET /compute/v2.1/servers/a6298d2a-d68f-486b-8701-cc07b3fbd52c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:27:43.149071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-845654485", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "networks": [{"uuid": "f0fb4dc6-8410-4ed7-b8c0-f2bf9fe5fa85"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:43.209835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] validate_networks() for [('f0fb4dc6-8410-4ed7-b8c0-f2bf9fe5fa85', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:27:43.588485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:27:43.589114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:27:43.589567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:27:43.590000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:27:43.590408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:27:43.603431 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.604174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.606066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.606811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.607329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.607766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.625903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Getting quotas for project 86ad1eb80d2a42c9871f992a85b27a17. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:27:43.629959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Getting quotas for user 7c0b3d9264174863b78e100a659e90bf and project 86ad1eb80d2a42c9871f992a85b27a17. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:27:43.641864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:27:43.644581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:27:43.762288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e2425b6-a858-4377-a96c-c8bc7a29309f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617443 Sep 02 21:27:43.769313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 238/431] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:27:43.775477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-62de8880-1817-47ef-a9d5-e42cf0fe257a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:43.776360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-62de8880-1817-47ef-a9d5-e42cf0fe257a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:43.838059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-62de8880-1817-47ef-a9d5-e42cf0fe257a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:43.845980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-62de8880-1817-47ef-a9d5-e42cf0fe257a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1213 microversion: 2.1 time: 0.074621 Sep 02 21:27:43.846936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 194/432] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:43 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:44.041345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:44.042027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:44.049783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.050297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.050738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.051457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.051924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.052360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.081110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b10ec975-284f-418c-87ed-ec76bf95e8b6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/ips" status: 200 len: 146 microversion: 2.1 time: 0.043521 Sep 02 21:27:44.081757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 239/433] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:27:44 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:44.872531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:44.873813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:44.876115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:44.882308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.882846 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.883431 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.884394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.884867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.885296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.970070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:44.977063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7238f0c2-1f31-4010-a52a-788dc05ff55a tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1217 microversion: 2.1 time: 0.108491 Sep 02 21:27:44.977677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 195/434] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:44 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:46.002939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:46.004314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:46.010617 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:46.011154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:46.011592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:46.012293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:46.012752 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:46.013172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:46.093794 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:46.106291 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-efdc5b35-bc63-4c7e-beb7-cb5defd90335 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1265 microversion: 2.1 time: 0.108729 Sep 02 21:27:46.122348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 240/435] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:45 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:47.141005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:47.143605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:47.160668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.161521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.163301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.164394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.167477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.168933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.255793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:47.265223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a49fcddb-3fd7-46ea-a3ae-eb419d870022 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1283 microversion: 2.1 time: 0.129585 Sep 02 21:27:47.266350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 196/436] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:47 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1283 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:48.292765 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:48.293629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:48.301233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.306402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.306402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.306402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.306402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.306884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.313776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7d85879-2c91-49ee-9bec-6aec2832f804"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:48.316454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:48.325374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.326224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.326689 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.327420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.327881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.328483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.500194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:48.515711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bdbc88f2-d1ff-4b28-b962-a2eae066b7fd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.226108 Sep 02 21:27:48.516444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 241/437] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:48 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:48.914714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3943939f-e7c5-496e-94f6-0c71478851c0", "tag": "0de4df85-988e-42e0-9e57-80edd7382cf8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:48.926428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.926912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.927343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.958398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] Creating event network-changed:0de4df85-988e-42e0-9e57-80edd7382cf8 for instance 3943939f-e7c5-496e-94f6-0c71478851c0 on hv-cinder-85221 Sep 02 21:27:48.958398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-f8b66887-190c-4005-8593-c26593a07b29 req-fdd9de06-b87c-4fa4-bf46-5e691344b032 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034450 Sep 02 21:27:48.958398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 242/438] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:49.558458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:49.559174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:49.566333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.566819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.567257 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.567961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.568419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.568846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.573363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:49.712203 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:49.721662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05824d4a-fbfb-4d7a-9a39-76f2d2166ed2 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.167558 Sep 02 21:27:49.722325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 243/439] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:49 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:50.746433 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:50.747123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:50.753631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.754141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.754574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.755289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.755739 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.756159 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.902797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:50.911280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-382f0e8e-5f6a-484e-a833-9d4669247e94 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.168851 Sep 02 21:27:50.911865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 244/440] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:50 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:51.933320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:51.933969 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:51.940780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.941270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.941731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:51.942436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.942895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.943640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.077502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:52.087452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9fa49f5c-36ec-40f2-bd1d-79e67c24949c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.156947 Sep 02 21:27:52.087452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 245/441] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:51 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:53.110934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:53.111586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:53.117457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.117975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.118420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.119114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.119570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.120000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.252568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:53.260294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-eee587d2-2e20-4e18-b376-ed9879d56a6d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.153860 Sep 02 21:27:53.260965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 246/442] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:53 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:53.471558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:53.472064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:53.478638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.479141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.479712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.480271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.480778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.481155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.507750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-379abe06-878d-4977-93b2-dd4025c6ed2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/ips" status: 200 len: 150 microversion: 2.20 time: 0.040207 Sep 02 21:27:53.508346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 247/443] 10.222.0.99 () {60 vars in 1289 bytes} [Fri Sep 2 21:27:53 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:27:53.842778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:54.285055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:54.285675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:54.287639 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:54.288309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:54.293035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.293514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.294094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.294706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.295840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.296295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.436958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:54.447099 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fabc6725-a56f-4e85-8a15-b3f287dbfa48 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.166077 Sep 02 21:27:54.447714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 248/444] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:54 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:55.470002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:55.470616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:55.478566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.479063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.479508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.480209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.480673 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.481122 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.698960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:55.707237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-30eb4b94-471d-4696-9fa0-de2af2c77e2e tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.241161 Sep 02 21:27:55.711682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 249/445] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:55 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:56.318299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2338d73f-38b4-458c-a49d-f7c9b8eecc76 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.008656 Sep 02 21:27:56.320396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 197/446] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:27:48 2022] POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments => generated 194 bytes in 8010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:56.735156 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:56.735800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:56.741872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.742360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.742799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.743491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.743946 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.744374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.881513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:56.890012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ae66180c-f762-46fa-9f9a-87517a599453 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.158911 Sep 02 21:27:56.890679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 250/447] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:56 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:57.914175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:57.914976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:57.924521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.924521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.924521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.924521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.924900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.924900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.072334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:58.080717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-51281c93-e948-437f-8def-99d5cb0119dd tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.170714 Sep 02 21:27:58.081208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 198/448] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:57 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:58.278426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:58.278963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:58.285457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.286249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.286405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.287270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.287729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.288174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.314432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lazy-loading 'flavor' on Instance uuid 6083d5d9-fba6-4f90-a05f-5a37896e59a3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:58.925054 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b43ced71-7b12-495d-8b18-60ee67ed5cf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/action" status: 202 len: 0 microversion: 2.20 time: 0.650453 Sep 02 21:27:58.926173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 251/449] 10.222.0.99 () {62 vars in 1319 bytes} [Fri Sep 2 21:27:58 2022] POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:27:58.935190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:58.937364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:58.943986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.944487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.944937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.945738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.946309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.946737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:59.107993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:59.108719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:59.110207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:59.116715 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:59.116910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:59.117236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:59.117669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:59.118458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:59.118914 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:59.119109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:59.119517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:59.120788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-868f523b-2b02-470f-b000-3becdcbd536c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.189656 Sep 02 21:27:59.121535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 199/450] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:58 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:27:59.300096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:59.309483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f6445449-cdab-47f8-8885-c7c97be8388d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.205286 Sep 02 21:27:59.310223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 252/451] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:59 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:00.151066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:00.151809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:00.159592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.160081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.160527 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.161238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.161698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.162150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.308681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:00.317951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:00.319331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:00.320513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0d3ba7e1-d504-45c2-9381-1fa5f85ef7f6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.173972 Sep 02 21:28:00.321285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 200/452] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:00 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:00.341296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:00.342103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:00.349080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.349560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.350098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.350793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.351245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.351717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.508256 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:00.517083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0379fc78-c90d-4e39-a249-10aedca3602f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.180297 Sep 02 21:28:00.518336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 253/453] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:00 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:01.347071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:01.347688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:01.354260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.355501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.355501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.355858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.356325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.356758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.490772 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:01.500302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:01.501987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:01.503190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-16403d92-ba8b-4e85-9f25-26e7703903ca tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.160748 Sep 02 21:28:01.503760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 201/454] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:01 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:01.541638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:01.542387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:01.544373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:01.550064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.550555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.550987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.551925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.552382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.552886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.701472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:01.725812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2256eb5a-9c71-40ae-859e-8de3736187e8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.187973 Sep 02 21:28:01.726411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 254/455] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:01 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:02.528485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:02.529739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:02.536733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.537226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.537668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.538394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.538845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.539264 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.681557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:02.690768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:02.692238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:02.693432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-63f1ec3f-08a7-4125-91a2-c7fd525b9bde tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.168962 Sep 02 21:28:02.694032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 202/456] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:02 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:02.748312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:02.748921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:02.756111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.756605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.757121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.758039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.758517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.758956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.894772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:02.902486 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c2db5140-97d2-4ec2-bdb4-d29a42260514 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.157962 Sep 02 21:28:02.903049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 255/457] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:02 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:03.718201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:03.718854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:03.725678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.726246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.726688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:03.727384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.727846 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.728275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:03.868983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:03.877957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:03.879590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:03.880920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4e8d524d-3b05-4dfc-8681-8140f64554fa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.166575 Sep 02 21:28:03.881419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 203/458] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:03 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:03.926004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:03.926638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:03.932691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.933179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.933611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:03.934403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.934862 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.935376 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:04.076417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:04.083320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-60a47190-8554-415e-a5f8-aeac8d9efed1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.161535 Sep 02 21:28:04.084352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 256/459] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:03 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:04.095010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3943939f-e7c5-496e-94f6-0c71478851c0", "name": "network-vif-plugged", "status": "completed", "tag": "0de4df85-988e-42e0-9e57-80edd7382cf8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:04.105506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:04.106079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:04.106577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:04.119479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] Creating event network-vif-plugged:0de4df85-988e-42e0-9e57-80edd7382cf8 for instance 3943939f-e7c5-496e-94f6-0c71478851c0 on hv-cinder-85221 Sep 02 21:28:04.131404 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-ee0b83e7-a728-46f4-a1e0-7f1e1dda2918 req-eba9915c-e7be-4034-9e13-888ad82d03a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036816 Sep 02 21:28:04.132119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 204/460] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:04.906270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:04.907520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:04.913803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:04.914292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:04.914732 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:04.915435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:04.915897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:04.916332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:05.052184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:05.060188 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:05.061666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:05.063357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8122f799-1103-4b43-bb35-c6849a45789f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.160514 Sep 02 21:28:05.063914 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 257/461] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:04 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:05.108681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:05.109370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:05.115701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:05.116214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:05.116614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:05.117299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:05.117782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:05.118210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:05.262214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:05.270939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-356257e3-159b-4ee8-8951-1794853b2fed tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.167173 Sep 02 21:28:05.271516 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 205/462] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:05 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:06.088437 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:06.089050 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:06.095773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.096273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.096700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.097407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.097899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.098333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.102450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:06.255478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:06.264146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:06.265584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:06.267769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-73d806c3-4f71-413a-87f4-712470f40bcb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.183042 Sep 02 21:28:06.272799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 258/463] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:06 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:06.293995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:06.294691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:06.301637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.302178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.302619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.303335 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.303798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.304221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.442984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:06.446635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:06.451084 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f858426d-75d8-4489-950d-fc3f428ef1f1 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.161169 Sep 02 21:28:06.451662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 206/464] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:06 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:07.299429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:07.300254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:07.306945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.307533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.308076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.308868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.309414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.309982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.457512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:07.465796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:07.467259 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:07.468428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b8f2ab59-d3e7-46c0-945b-d414a13dcab3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.173981 Sep 02 21:28:07.469295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 259/465] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:07 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:07.475737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:07.476452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:07.483699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.484207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.484645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.485370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.485849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.486285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.623360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:07.632186 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d8736ea7-97ca-4d26-8517-08d190c7ac2d tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1313 microversion: 2.1 time: 0.160515 Sep 02 21:28:07.632759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 207/466] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:07 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:08.494011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:08.495103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:08.500585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.501663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.502255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.503258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.503434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.503854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.634923 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:08.643468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:08.645166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:08.646364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-754d6148-bc96-4c18-b7e3-47a830722fe5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.156365 Sep 02 21:28:08.646925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 260/467] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:08 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:08.655558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:08.656167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:08.663224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.663703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.664213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.664819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.665263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.665686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.797676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:08.806421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-38852aad-0b5d-45ac-9813-a45cdf38ce2f tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1497 microversion: 2.1 time: 0.154969 Sep 02 21:28:08.807040 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 208/468] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:08 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:09.415947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:09.415947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.416413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.417007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.480994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Going to try to stop instance {{(pid=121276) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 21:28:09.637803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1ace3719-691d-4e2d-b29b-11d735c10b00 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.232531 Sep 02 21:28:09.638564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 261/469] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:28:09 2022] POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:28:09.647400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:09.648021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:09.654259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.654742 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.655178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.655869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.656406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.656731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.672527 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:09.673339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:09.679576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.680072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.680658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.681396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.681899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.682332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.858250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:09.867663 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8865e804-bdb5-4732-a861-f2595a95bd34 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.224180 Sep 02 21:28:09.868179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 209/470] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:09 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:09.870822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:09.873260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:09.874002 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:09.880926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.881421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.881562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:09.881914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.882619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.883081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.883483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:09.883596 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.884791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6e2305b9-912e-4fcd-aefc-4e9d5eeb7db5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.216805 Sep 02 21:28:09.885432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 262/471] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:09 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:09.909088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:28:10.160120 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-123dccde-6aa0-4991-a6ac-785d6684e4d8 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 204 len: 0 microversion: 2.1 time: 0.290596 Sep 02 21:28:10.160780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 210/472] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:28:09 2022] DELETE /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:28:10.169165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:10.171823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:10.176364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.176849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.177286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.178013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.178466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.178890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.312881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:10.321313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd7528d0-0858-43e2-9e2e-a4891f57ff4c tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1503 microversion: 2.1 time: 0.156067 Sep 02 21:28:10.321891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 263/473] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:10 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:10.891803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:10.892495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:10.899201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.899720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.900153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.900839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.901289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.901729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.910979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:10.911575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:10.917426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.917949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.918376 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.919063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:10.919513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:10.919932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:11.104359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:11.111718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:11.114281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e9355a55-e1ab-46f8-a96e-2eb184fdd91b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.226677 Sep 02 21:28:11.114870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 211/474] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:10 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:11.120276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:11.121748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:11.123097 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e423f488-7d7c-41c8-a79a-a4f59e99d670 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.216287 Sep 02 21:28:11.123471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 264/475] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:10 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:11.346181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:11.346789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:11.358406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:11.358406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:11.358406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:11.358406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:11.358819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:11.358819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:11.486814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:11.494631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1cd9662f-6194-4008-9bde-8b2000ec9282 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1503 microversion: 2.1 time: 0.153141 Sep 02 21:28:11.495206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 212/476] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:11 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:12.138240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:12.138902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:12.145340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.145857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.146388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.147084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.147531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.147953 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.149026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:12.149642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:12.156118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.156610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.157065 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.158183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.158644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.159078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.349101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:12.351975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:12.357635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3cc5914a-24a0-406a-a8a6-0db173bf72a9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.223121 Sep 02 21:28:12.358543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 265/477] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:12 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:12.360196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:12.362344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:12.363625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d6099fb5-a7f2-4d1a-b584-83af255e65dd tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.218749 Sep 02 21:28:12.365392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 213/478] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:12 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:12.518005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:12.518655 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:12.524917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.525395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.525869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.526560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:12.527013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:12.527439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:12.703688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:12.712504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-769127cb-21c9-4259-a170-15f87b0ed7df tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1503 microversion: 2.1 time: 0.198515 Sep 02 21:28:12.713143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 266/479] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:12 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:13.193414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3943939f-e7c5-496e-94f6-0c71478851c0", "name": "network-vif-deleted", "tag": "0de4df85-988e-42e0-9e57-80edd7382cf8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:13.204799 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.205471 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.205966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.217337 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] Creating event network-vif-deleted:0de4df85-988e-42e0-9e57-80edd7382cf8 for instance 3943939f-e7c5-496e-94f6-0c71478851c0 on hv-cinder-85221 Sep 02 21:28:13.225347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-784de0fd-c9b9-46a8-a913-df4d58888c63 req-b4bc9986-bcfe-4011-8835-d095eb724b75 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Sep 02 21:28:13.226592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 214/480] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:13.382546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:13.383089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:13.389338 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.389781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.390232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.390929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.391381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.391956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.393298 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:13.394042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:13.400658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.401142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.401622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.402343 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.402793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.403220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.595786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:13.604227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8c2d57bf-79d7-4909-9194-2cb0d3412d60 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.225652 Sep 02 21:28:13.612376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:13.621596 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:13.624977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:13.624977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dbb4eef8-cc12-42c5-b9bb-ac55b1565511 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.235709 Sep 02 21:28:13.627247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 267/481] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:13 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:13.642203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 215/482] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:13 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:13.737043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:13.737663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:13.743634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.744124 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.744559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.745251 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.745704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.746156 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.779685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:13.780188 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:13.780631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:13.781123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lazy-loading 'fault' on Instance uuid 3943939f-e7c5-496e-94f6-0c71478851c0 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:13.827107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b3d9264174863b78e100a659e90bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad1eb80d2a42c9871f992a85b27a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:13.835755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4ed5b8c6-f501-4e8d-a5b7-447700f454e5 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 200 len: 1303 microversion: 2.1 time: 0.103158 Sep 02 21:28:13.836366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 268/483] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:13 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:14.636466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:14.637106 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:14.646559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:14.647057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:14.647499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:14.648267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:14.648730 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:14.649210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:14.650117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:14.650720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:14.657856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:14.658397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:14.658840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:14.659550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:14.660010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:14.660443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:15.075133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:15.084601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1d9c6fb0-c121-4dc8-aae9-b663f8481711 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.451938 Sep 02 21:28:15.085457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 216/484] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:14 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:15.097460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:15.098482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:15.099126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] [instance: 3943939f-e7c5-496e-94f6-0c71478851c0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:15.105488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:15.106003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:15.106423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:15.107122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:15.107578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:15.108003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:15.108240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:15.109706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:15.111137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-030c8249-1b8b-48fa-ae60-786762e95891 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.464729 Sep 02 21:28:15.111721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 269/485] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:14 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:15.125307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] HTTP exception thrown: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Request method failure captured: Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 HTTP/1.1 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUkvZHmViOjWZP1NGI1bLl9xdTD1QQuWnz74KRx7CKRp-oNEd5nQuTrFqN7lTyc-mQ1LxiPG2Qq2JkNDMpotcgCfHgQBHHzzmvAt_yrOsevFtkwM6gedNJP9mIhO-Yqj0GlZvl0x6KpmFCSG_7d_Xu9RJc4gmD2_oX-JrgLOQYJRE0 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 86ad1eb80d2a42c9871f992a85b27a17 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesActionsTest-686363653 Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:28:15.127708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86ad1eb80d2a42c9871f992a85b27a17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86ad1eb80d2a42c9871f992a85b27a17", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesActionsTest-686363653 Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 86ad1eb80d2a42c9871f992a85b27a17 Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesActionsTest-686363653 Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesActionsTest-686363653-project Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7c0b3d9264174863b78e100a659e90bf Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesActionsTest-686363653-project Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. Sep 02 21:28:15.135087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '3943939f-e7c5-496e-94f6-0c71478851c0'} Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:28:15.135822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. Sep 02 21:28:15.137083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:28:15.140939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] Returning 404 to user: Instance 3943939f-e7c5-496e-94f6-0c71478851c0 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:28:15.140939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0b83e928-4301-41a1-8d6b-5546df862270 tempest-VolumesActionsTest-686363653 tempest-VolumesActionsTest-686363653-project] 10.222.0.99 "GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0" status: 404 len: 111 microversion: 2.1 time: 0.034596 Sep 02 21:28:15.140939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 217/486] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:15 2022] GET /compute/v2.1/servers/3943939f-e7c5-496e-94f6-0c71478851c0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:28:15.804558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "341f7add-d662-4427-93c1-7cf68c115039", "device": "/dev/sdb"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:15.807671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:15.814162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:15.814576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:15.815082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:15.815781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:15.816239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:15.816662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:16.116589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:16.116589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:16.122171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:16.123015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:16.123564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:16.124342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:16.124869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:16.125365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:16.317842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:16.326788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-79ed9e8a-30b6-4b73-9109-459717eee638 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.217260 Sep 02 21:28:16.327371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 218/487] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:16 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:16.332595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:16.334026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:16.342920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:16.342920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:16.342920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:16.344142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:16.345447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:16.346090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:16.508250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:16.517470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:16.519376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:16.520870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-42776250-09ab-4a1e-b2e4-1daf0ffa4e09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.192556 Sep 02 21:28:16.521442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 219/488] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:16 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:16.800107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f92a2a69-df25-4351-8957-6e4688577d9a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "POST /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.999401 Sep 02 21:28:16.800894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 270/489] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:28:15 2022] POST /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c/os-volume_attachments => generated 194 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:17.352437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:17.353058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:17.355517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:17.361590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:17.364910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:17.364910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:17.364910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:17.364910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:17.365371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:17.502320 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:17.510717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5c39345d-f530-43b7-8f83-0df411f0f50a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.162096 Sep 02 21:28:17.511295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 220/490] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:17 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:17.562860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:17.563567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:17.569758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:17.570547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:17.570668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:17.571330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:17.571785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:17.572212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:17.706177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:17.714396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:17.715855 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:17.717018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-89661683-1db6-4b31-9efd-52f87be60177 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.158936 Sep 02 21:28:17.717579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 271/491] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:17 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:18.536436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:18.537141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:18.543757 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:18.544241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:18.544678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:18.545365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:18.545850 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:18.546284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:18.688578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:18.697259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eea02845-242c-4e5c-a74b-4c14e3cfb2cb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.165792 Sep 02 21:28:18.697877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 221/492] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:18 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:18.742827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:18.743427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:18.750591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:18.751069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:18.751573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:18.752300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:18.752753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:18.753172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:18.757536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:18.888890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:18.898898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:18.900584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:18.901465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-62901932-a8f8-4a75-b222-11391bb12d80 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.162519 Sep 02 21:28:18.902050 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 272/493] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:18 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:19.721027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:19.721645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:19.728232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:19.728715 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:19.729155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:19.729886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:19.730346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:19.730773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:19.868912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:19.877766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b7a91758-0d5a-40c7-9bba-fa66eec6aaec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.161334 Sep 02 21:28:19.878332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 222/494] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:19 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:19.927645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:19.928285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:19.935255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:19.935745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:19.936190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:19.936884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:19.937345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:19.937793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:20.073108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:20.081429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:20.088995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:20.088995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-354fa7f9-09de-4c9b-bdef-31032f659a64 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.161326 Sep 02 21:28:20.088995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 273/495] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:19 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:20.900774 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:20.901321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:20.908612 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:20.909241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:20.909685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:20.910423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:20.910886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:20.911317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:20.915620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:21.050604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:21.059342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4e985e5-5773-4759-b88e-dff8597a7e8a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.162455 Sep 02 21:28:21.059923 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 223/496] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:20 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:21.112788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:21.113407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:21.120319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:21.121054 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:21.121607 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:21.122332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:21.122786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:21.123209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:21.265568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:21.275251 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:21.276727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:21.277933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-71e35b75-6266-4171-bd99-44929fb11d38 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.169204 Sep 02 21:28:21.278495 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 274/497] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:21 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:22.084176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:22.084792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:22.092231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:22.092732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:22.093175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:22.093982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:22.094450 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:22.094882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:22.247265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:22.257376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d5c1effd-b9a4-4594-a8d2-28d757840fec tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.177273 Sep 02 21:28:22.258017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 224/498] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:22 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:22.303362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:22.303964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:22.310050 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:22.310567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:22.311002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:22.311705 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:22.312160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:22.312586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:22.469387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:22.478384 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:22.479832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:22.481014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-363ae28e-c8da-46de-aa9d-d60529d89a2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.182489 Sep 02 21:28:22.481743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 275/499] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:22 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:23.286280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:23.286950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:23.294133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:23.294921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:23.295537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:23.296438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:23.297134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:23.297809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:23.478428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:23.489508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e9ad8537-f061-4917-a2d7-53dba8874c6c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.208037 Sep 02 21:28:23.490279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 225/500] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:23 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:23.512210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:23.512946 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:23.522593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:23.523567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:23.524463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:23.526165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:23.527334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:23.528186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:23.756418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:23.771027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:23.773577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:23.775344 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bfba7240-397b-4f93-b959-7d8e9b43286b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.268674 Sep 02 21:28:23.782170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 276/501] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:23 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:24.514739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:24.515987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:24.523068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:24.523662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:24.524194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:24.524999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:24.525468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:24.525949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:24.718909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:24.732290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-11de012b-9a80-4908-a11c-55ea45888616 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.222198 Sep 02 21:28:24.733342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 226/502] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:24 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:24.820216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:24.822005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:24.830451 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:24.831281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:24.831888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:24.832865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:24.834025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:24.834684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:25.029087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:25.038877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:25.040328 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:25.041508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0cf81041-6bcf-4d50-8b70-fd1d2cc718f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.228837 Sep 02 21:28:25.053995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 277/503] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:24 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:25.757349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:25.758314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:25.765076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:25.765982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:25.766611 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:25.768092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:25.768847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:25.769460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:25.938438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:25.947600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2ceac3de-0341-4f68-abc9-9c75539e77ff tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.194075 Sep 02 21:28:25.948180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 227/504] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:25 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:26.075768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:26.085076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:26.106291 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:26.108493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:26.108493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:26.108771 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:26.109229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:26.109668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:26.293625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:26.303450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:26.306644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:26.308226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f47e2056-7dde-4a30-9012-1260876f6e2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.240180 Sep 02 21:28:26.322260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 278/505] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:26 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:26.974662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:26.976159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:26.982987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:26.983783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:26.984438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:26.985366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:26.986910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:26.987645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.142778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:27.152280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-78856450-60fe-45c6-8f82-e7dbf7a1d67e tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1700 microversion: 2.1 time: 0.184282 Sep 02 21:28:27.166228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 228/506] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:26 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1700 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:27.177257 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:27.183914 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:27.184407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:27.184956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.213149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Going to try to start instance {{(pid=121276) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 21:28:27.337955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:27.339930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:27.348142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:27.348882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:27.349403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.350222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:27.350783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:27.351296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.424626 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a5735447-d0cf-4451-ae31-474cde59871a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.251681 Sep 02 21:28:27.432280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 279/507] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:28:27 2022] POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:28:27.449888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:27.453949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:27.464880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:27.464880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:27.464880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.464880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:27.465279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:27.465279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:27.561603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:27.579508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:27.584197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:27.586154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e90c719-9009-4ca7-9d59-331e47ad9bc5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.252980 Sep 02 21:28:27.587411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 229/508] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:27 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:27.738369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:27.747923 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a24df890-498a-43b3-a089-abb139bd362f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1709 microversion: 2.1 time: 0.309835 Sep 02 21:28:27.748902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 280/509] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:27 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1709 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:28.195808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "name": "network-vif-plugged", "status": "completed", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:28.209608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.218647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.218647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.223476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] Creating event network-vif-plugged:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:28:28.229286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-23940238-795f-4fa8-9b8c-d25a3b6d58bd req-048e5e0c-366b-495e-8c59-c8d6e641401b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 Sep 02 21:28:28.230035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 230/510] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:28.640770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:28.641464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.652300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.655097 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.655968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.657493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.658530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.659230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.787978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:28.789627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.804072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.805363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.806784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.808360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.809476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.810601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.905774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:28.929935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:28.932180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:28.934090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a31f8077-b903-49b4-b674-5187727c256f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.297378 Sep 02 21:28:28.935681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 281/511] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:28 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:29.034130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:29.044366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-196dae7b-8d6b-41b2-9229-400c274f4bf0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1709 microversion: 2.1 time: 0.265414 Sep 02 21:28:29.045283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 231/512] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:28 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1709 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:29.964859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:29.968796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:29.981403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:29.982002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:29.982448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:29.983388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:29.985009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:29.985648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.070506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:30.070506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:30.085351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.097271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.099373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.100441 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.101176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.101864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.470279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:30.500149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2dfc1ee4-2826-4454-9c01-1dc39d4f0176 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1709 microversion: 2.1 time: 0.434901 Sep 02 21:28:30.506748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 232/513] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:30 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1709 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:30.546802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:30.555993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:30.558025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:30.559417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9003ede6-2eb8-4aef-b80d-8b121c081e2d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1743 microversion: 2.20 time: 0.602063 Sep 02 21:28:30.560077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 282/514] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:29 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1743 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:31.533777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:31.535118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:31.545855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.545855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.545855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.545855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.546339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.546339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.596052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:31.597320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:31.620865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.622611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.624872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.626034 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.629863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.635682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.843963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:31.868006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f1e93176-dd4e-412b-a459-31a147b8861a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1709 microversion: 2.1 time: 0.340761 Sep 02 21:28:31.891439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 233/515] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:31 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1709 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:31.943105 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:31.958148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:31.959831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:31.961396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8064247c-35cb-4764-9cbd-08cbe2d4c292 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.371923 Sep 02 21:28:31.966907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 283/516] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:31 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:32.915859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.917216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:32.924694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.925533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.926238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.927190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.927958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.928555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.996081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.997454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:33.010525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=62 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.014199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:33.017214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:33.019311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:33.022203 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:33.023306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:33.024517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:33.198529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.219131 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1e219570-b8c1-4826-91a0-98bfec8fa7bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1713 microversion: 2.1 time: 0.307318 Sep 02 21:28:33.219970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 234/517] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:32 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1713 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:33.342462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.360567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.363011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.364515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5e0f7fb6-229a-4a2d-9ade-0add423f6b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.375282 Sep 02 21:28:33.366222 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 284/518] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:32 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:34.401597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:34.402449 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:34.426323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.427222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.427900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.435758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.436739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.437317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.652347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.663796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.665285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.666541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f74ee7e3-a24f-4e45-82db-404339e49395 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.274366 Sep 02 21:28:34.668223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 235/519] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:34 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:35.698955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:35.699584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:35.708258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.745038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.745038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:35.745038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.745038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.745562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:35.871066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.885321 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.891867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.892151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d96379c9-c412-463f-9015-592f31f95fc0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.197096 Sep 02 21:28:35.893741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 285/520] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:35 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:36.921324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:36.922710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:36.929850 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:36.930666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:36.931115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:36.931845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:36.932317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:36.932751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.091420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:37.101939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:37.103421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:37.104976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-61a21e0d-3893-4f34-afff-97899547af91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.188223 Sep 02 21:28:37.106321 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 236/521] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:36 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:38.149691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:38.162169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:38.184454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.186067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.190761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.192836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.193993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.195685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.573759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.594716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.598988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.601299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-583dec82-8cb4-40b5-9433-e5e504d6648e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.465106 Sep 02 21:28:38.607359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 286/522] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:38 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:39.636928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:39.638583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:39.649936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.650559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.651100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.652071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.652537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.652971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.863917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.872525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.874008 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.875196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4ff9a23-dc64-4a04-92ad-1162a8c01b15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.242545 Sep 02 21:28:39.876017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 237/523] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:39 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:40.911197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:40.912568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:40.920701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.921507 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.922216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.923130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.923902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.925042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.131677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.137103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:41.145098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.147297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.152709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8790a426-1733-41d7-86bb-c3e397d311ee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.245867 Sep 02 21:28:41.152709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 287/524] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:40 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:42.180919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:42.180919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:42.194072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.194599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.195178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.195913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.196531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.196887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.510931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:42.525535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:42.527095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:42.528352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dd55ba75-bdc4-4edb-b08d-b0840536395f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.352184 Sep 02 21:28:42.546298 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 238/525] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:42 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:43.562660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:43.563775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:43.594284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:43.595452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:43.596893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:43.598177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:43.599059 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:43.599670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:43.797874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:43.812028 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:43.814310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:43.816962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5eecbc70-e54e-4e1f-a7e9-2913cd081d4d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.260527 Sep 02 21:28:43.817989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 288/526] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:43 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:44.850035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:44.850685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:44.856914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:44.857414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:44.857885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:44.858748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:44.859218 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:44.859647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.059817 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:45.074303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:45.076423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:45.078329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-10999d6f-b38a-4716-8eac-973b88060848 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.233239 Sep 02 21:28:45.081766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 239/527] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:44 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:46.107741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:46.108422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:46.118610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:46.118610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:46.118610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:46.118610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:46.119021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:46.119021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:46.252958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:46.261287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:46.262776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:46.263943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0d19d0db-158d-477d-8624-6085cfcc8c07 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1738 microversion: 2.20 time: 0.160785 Sep 02 21:28:46.264508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 289/528] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:46 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:47.289729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:47.290628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:47.297124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:47.297598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:47.298079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:47.298780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:47.299233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:47.299655 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:47.319948 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:47.438190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:47.446624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:47.448118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:47.449273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fb3ca4a2-a831-4a4a-be3e-a598de613697 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.163560 Sep 02 21:28:47.449858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 240/529] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:47 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:48.476094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:48.476681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:48.483390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:48.483929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:48.484365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:48.485078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:48.485532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:48.490659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:48.669606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:48.681909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:48.682332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:48.683541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-12434f39-91bb-42a3-8fdb-e1aa2edf69be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.211754 Sep 02 21:28:48.684183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 290/530] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:48 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:49.740883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:49.741497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:49.743915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=42 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:49.749701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:49.750247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:49.750692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:49.751411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:49.751902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:49.752299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:49.884559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:49.892712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:49.894232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:49.895399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e3ca8c6b-a4c6-4d91-895b-0ec81896bd28 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.158972 Sep 02 21:28:49.895964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 241/531] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:49 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:50.921008 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:50.921553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:50.927927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:50.928399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:50.928821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:50.929503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:50.929970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:50.930389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:51.069223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:51.077657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:51.079223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:51.080378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d2185eb1-f0fe-43d3-923c-6f603d70ff6c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.163351 Sep 02 21:28:51.080936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 291/532] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:50 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:51.902482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "name": "network-vif-unplugged", "status": "completed", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:51.914249 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:51.920187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:51.920187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:51.928246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] Creating event network-vif-unplugged:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:28:51.933533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d1a748f7-4930-4a97-84d6-9d5222e92678 req-fb3de1f1-9275-460c-944b-c88345c6a72d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034872 Sep 02 21:28:51.934233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 242/533] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:52.106316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:52.106931 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:52.113311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:52.114342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:52.115422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:52.116161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:52.116588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:52.117015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:52.252574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:52.262786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:52.264254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:52.265471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6f8e4d52-ea89-4ff2-90fa-43879d24322c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.163103 Sep 02 21:28:52.266096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 292/534] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:52 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:53.293439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:53.294189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:53.301050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:53.302166 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:53.302616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:53.303346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:53.304593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:53.304593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:53.570963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.573583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.575139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.576401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-51f2146b-6a21-4258-a438-a8715dae516a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.288636 Sep 02 21:28:53.577056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 243/535] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:53 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:54.607254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:54.607877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:54.615436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:54.616079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:54.616606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:54.617314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:54.617789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:54.618221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:54.983489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.993899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.994529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.995721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0f49558b-f412-4446-9713-92e15a4e8b09 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1720 microversion: 2.20 time: 0.392652 Sep 02 21:28:54.999642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 293/536] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:54 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1720 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:56.023878 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:56.031451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:56.033635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.034294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.034889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.035843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.036993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.037695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.227587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.236211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.237674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.238935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4bb1f58-329b-438b-99ac-e9cd2f6f1b76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1723 microversion: 2.20 time: 0.220505 Sep 02 21:28:56.240258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 244/537] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:56 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:56.285915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38f5a3c0-30bd-4e8c-b1ff-f719cfb0c986"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:56.290457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:56.297634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.298156 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.298590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.299322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.299958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.300721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.865252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:56.865766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:56.871724 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.872207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.872643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.873346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.874085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.874514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.012371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'services' on Instance uuid 7a658e9d-9680-4d98-9d62-928ea9eaed1c {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:57.350684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a6c3cc4d-2155-4782-b30c-51f9ad36d4da tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c/os-volume_attachments/341f7add-d662-4427-93c1-7cf68c115039" status: 202 len: 0 microversion: 2.1 time: 0.489637 Sep 02 21:28:57.351673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 245/538] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:28:56 2022] DELETE /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c/os-volume_attachments/341f7add-d662-4427-93c1-7cf68c115039 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:28:57.698850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d99e2a0d-cfdb-4741-9bc3-55296a719a2f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.420752 Sep 02 21:28:57.699681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 294/539] 10.222.0.99 () {62 vars in 1364 bytes} [Fri Sep 2 21:28:56 2022] POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments => generated 188 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:28:57.846238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:57.846947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:57.854433 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.854918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.855364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.856071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.856537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.856974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.910548 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121277) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:28:58.256324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1d9d10f9-e159-407f-9789-1c4739e6c498 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/action" status: 202 len: 0 microversion: 2.20 time: 0.414673 Sep 02 21:28:58.257279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 246/540] 10.222.0.99 () {62 vars in 1319 bytes} [Fri Sep 2 21:28:57 2022] POST /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:28:58.266617 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:58.267429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:58.276571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:58.277241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:58.278037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:58.278846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:58.279525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:58.280020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:58.429812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:58.439290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:58.441250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:58.443276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-66a7f907-4dee-4084-92bb-391b26f41d39 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1749 microversion: 2.20 time: 0.180842 Sep 02 21:28:58.444131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 295/541] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:58 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:59.081966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1274629660", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:59.137813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] validate_networks() for None {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:28:59.444314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:28:59.444588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:28:59.445095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:28:59.445505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:28:59.445944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:28:59.456813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.457303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.457862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.458491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.459673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.460280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.470764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.471398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.479727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.480495 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.481113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.481873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.482330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.482905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.484117 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Getting quotas for project 99ed0de2b2bf4173919e3ed69467f408. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:28:59.488698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Getting quotas for user f7f0dd60f95b442aa893f1a1eda4e275 and project 99ed0de2b2bf4173919e3ed69467f408. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:28:59.506642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:28:59.509997 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:28:59.636164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.645289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.647882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.649245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0221597f-0b6a-47a7-9c88-749c31bf4de2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1749 microversion: 2.20 time: 0.182910 Sep 02 21:28:59.650133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 296/542] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:59 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:59.654721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.655219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.671658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.672139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.672583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.673290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.673770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.674205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.683882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9ae86b68-3a44-49ab-adc1-3b524ff8268a tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606531 Sep 02 21:28:59.685053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 247/543] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:28:59.697532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2676f326-d656-4e30-b1e7-1731581efc64 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.698177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2676f326-d656-4e30-b1e7-1731581efc64 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.705323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:28:59.770767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2676f326-d656-4e30-b1e7-1731581efc64 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.785127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2676f326-d656-4e30-b1e7-1731581efc64 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1215 microversion: 2.1 time: 0.091567 Sep 02 21:28:59.797956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 248/544] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:59 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:00.042686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2c939912-baf0-44fe-8efd-01698be08be0 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 204 len: 0 microversion: 2.1 time: 0.391114 Sep 02 21:29:00.043511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 297/545] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:28:59 2022] DELETE /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:29:00.053340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:00.054016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:00.060212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.060701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.061139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.062170 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.062561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.062990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.216314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:00.224728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c1ec980e-ebdb-4213-bc2c-235b69252045 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1512 microversion: 2.1 time: 0.176668 Sep 02 21:29:00.225311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 249/546] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:00 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:00.676994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:00.677702 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:00.684378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.689922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.689922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.689922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.689922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.690268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.812153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-967b736b-7a8e-40a2-9f54-9ed4db3dd3ec tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:00.813097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-967b736b-7a8e-40a2-9f54-9ed4db3dd3ec tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:00.822961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:00.832157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:00.833707 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:00.835475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7adedf6a-d75e-464c-a803-bb12c4d3ba15 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1749 microversion: 2.20 time: 0.162796 Sep 02 21:29:00.836036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 298/547] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:00 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:00.866837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-967b736b-7a8e-40a2-9f54-9ed4db3dd3ec tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:00.873844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-967b736b-7a8e-40a2-9f54-9ed4db3dd3ec tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1215 microversion: 2.1 time: 0.067522 Sep 02 21:29:00.874428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 250/548] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:00 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:01.248571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:01.249324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:01.256466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.257557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.258323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.259048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.259508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.259992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.418279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.426398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-eccfcb5c-358d-4be3-8987-0a6c85379c8b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1512 microversion: 2.1 time: 0.181773 Sep 02 21:29:01.427342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 299/549] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:01 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:01.863928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:01.865064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:01.877328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.878245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.879030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.880291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.881906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.882563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.896406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:01.898091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:01.905530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.906053 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.906500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.907205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.907698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.908131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.913159 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:01.994653 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.002129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aac86f3f-ef12-4b40-852f-37f8ff2fdc91 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1219 microversion: 2.1 time: 0.109440 Sep 02 21:29:02.002717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 300/550] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:01 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:02.071127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.079918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.081361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.082548 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-10fac1e5-b9b8-4795-82b1-9add0b03c7a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1751 microversion: 2.20 time: 0.225917 Sep 02 21:29:02.083106 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 251/551] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:01 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:02.450951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:02.452324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.462052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.463128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.464407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.465164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.465630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.466099 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.734417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.743218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-273deee7-8ea2-4a82-baa5-16370796ce32 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1512 microversion: 2.1 time: 0.296556 Sep 02 21:29:02.743996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 301/552] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:02 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:03.027942 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:03.028555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:03.035374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.035860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.036295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.037010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.038017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.038442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.113482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:03.114131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:03.117215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:03.132225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.132735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.133183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.133952 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.134421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.134858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.145946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.155691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df581b5e-4183-493e-8e7d-45ed049a2a84 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1267 microversion: 2.1 time: 0.131520 Sep 02 21:29:03.156279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 252/553] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:03 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:03.184065 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a658e9d-9680-4d98-9d62-928ea9eaed1c", "name": "network-vif-deleted", "tag": "35fb5adf-342b-472e-9def-e585978bdf8b"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:03.195720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.196581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.198018 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.213542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] Creating event network-vif-deleted:35fb5adf-342b-472e-9def-e585978bdf8b for instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c on hv-cinder-85221 Sep 02 21:29:03.219309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-3318f8e9-376e-4bfc-aa81-53878cfdc5c5 req-66f13e5d-8de5-433a-85d7-1f1c3b891830 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038959 Sep 02 21:29:03.220158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 253/554] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:03.294832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.305517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.307059 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.308372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4dbfd9d5-90f8-4780-9644-87c73a82b5a2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1751 microversion: 2.20 time: 0.199251 Sep 02 21:29:03.308982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 302/555] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:03 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:03.774192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:03.775113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:03.782050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.782650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.783091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.783805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.784280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.784711 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.823402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.823638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.824082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.824547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid 7a658e9d-9680-4d98-9d62-928ea9eaed1c {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:03.902083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.913319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c580e213-32e9-4f9e-aa1b-ea2537f6e500 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1308 microversion: 2.1 time: 0.143770 Sep 02 21:29:03.914213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 254/556] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:03 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:04.189003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.189614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.197322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.198504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.198939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.199667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.200129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.200738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.299942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.309260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8ad148ec-1224-4cd8-8c29-29b2478611b9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1273 microversion: 2.1 time: 0.124389 Sep 02 21:29:04.309895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 303/557] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:04.339153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.345378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.346336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.346829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.347263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.347967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.348415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.348835 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.591325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.597579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.597579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.597579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a6dc0da2-94e4-46f9-9c64-dd67d8ca0469 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1751 microversion: 2.20 time: 0.262614 Sep 02 21:29:04.597950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 255/558] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:04.950311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.955082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.958098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.958795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.960211 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.961123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.961773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.962432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.999770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.000262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.000703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.001153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid 7a658e9d-9680-4d98-9d62-928ea9eaed1c {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:05.078082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.093154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3205d492-a902-46cc-b642-dbfef56ec7c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 200 len: 1308 microversion: 2.1 time: 0.147935 Sep 02 21:29:05.094389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 304/559] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 1308 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:05.332713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:05.333358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:05.339995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.340761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.340945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.342288 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.343320 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.343913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.508663 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.516821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b685e27c-2fd4-43be-b56c-45eefd8f2cb7 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.187899 Sep 02 21:29:05.517513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 256/560] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:05 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:05.627800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:05.629004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:05.637277 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.638077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.638851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.639788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.640263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.640704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.889378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.908627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.910715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.912285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-941aaed4-0d7b-4994-9b8a-a57820c4b40d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.292761 Sep 02 21:29:05.913260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 305/561] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:05 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:06.077195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bd19a9-029f-497c-86c6-f16a291ca1b0", "tag": "e23c5f7d-dcf6-4425-930d-0463a8573866"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:06.088054 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.088681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.089222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.101446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] Creating event network-changed:e23c5f7d-dcf6-4425-930d-0463a8573866 for instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 on hv-cinder-85221 Sep 02 21:29:06.106975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d2a013bc-3aa7-4a63-b3f0-293f26b3093a req-8b111409-aee7-49da-9cdd-f0a802982dfd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Sep 02 21:29:06.107717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 257/562] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:06.117091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.117815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: 7a658e9d-9680-4d98-9d62-928ea9eaed1c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.124169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.124731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.125911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.126731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.127428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.127930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.143881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] HTTP exception thrown: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Request method failure captured: Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c HTTP/1.1 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUj876_BTZWs4duNHtOwQIq3Ph9rWtKXiA1ZVxePOrp-jSQSZOeNxe0l9zkhSuvW3HkarxRm_bnlwqv_n56m92gGvlPd1jQHhtaflywwy4CIhgqnWkNpdHv8f3LNvB4lZPJj58LHRzRq6_icnGyeSw4o5OywuNLG-RXnq0YaIDuQB0 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: cbffdee4dc4341e4a33fcfe884f28072 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:29:06.146523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cbffdee4dc4341e4a33fcfe884f28072", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: cbffdee4dc4341e4a33fcfe884f28072 Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotTestJSON-1694924172-project Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 50dab514c64d47d095bd6d1ac8ce3b56 Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotTestJSON-1694924172-project Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. Sep 02 21:29:06.149121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '7a658e9d-9680-4d98-9d62-928ea9eaed1c'} Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:29:06.149964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. Sep 02 21:29:06.151295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:29:06.152577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Returning 404 to user: Instance 7a658e9d-9680-4d98-9d62-928ea9eaed1c could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:29:06.152577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c0b06d36-726a-4cf3-b93f-c354e30dcbfb tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c" status: 404 len: 111 microversion: 2.1 time: 0.036354 Sep 02 21:29:06.152577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 306/563] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/7a658e9d-9680-4d98-9d62-928ea9eaed1c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:29:06.542198 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.543424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.550470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.550972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.551491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.552273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.552644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.553124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.772453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:06.780958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-897ed5e5-cab7-4226-8c52-bc7a4440e98f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.244192 Sep 02 21:29:06.793921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 258/564] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:06.949925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.950545 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.957521 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.958047 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.958490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.959831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.960334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.960757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.128400 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:07.137801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:07.139563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:07.140828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ec525621-55f0-49f9-949e-aae03b6d0a03 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.194916 Sep 02 21:29:07.141706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 307/565] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:07.805444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:07.806200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:07.813808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.814551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.815183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.816061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.816687 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.817275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.003539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.010501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:08.017013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9e09fb73-92c7-4ce0-b0eb-ebbb1f827ad9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.216059 Sep 02 21:29:08.017619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 259/566] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:07 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:08.169597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:08.170200 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:08.176708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.177187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.177625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.178982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.179624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.180055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.354434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.367152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.368585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.369792 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b45981e0-2778-4a50-99a5-97a0c67d8de5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.204312 Sep 02 21:29:08.370347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 308/567] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:08 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:09.041989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:09.042725 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:09.049490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.050011 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.050459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.051163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.051622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.052054 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.196125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.204283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c81fd50-89fa-47e8-bbcb-ae5475f1de73 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.166643 Sep 02 21:29:09.207519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 260/568] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:09 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:09.396075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:09.396616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:09.403970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.404747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.405193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.406007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.406657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.407098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.575598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.588797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.591292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.593387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9d6373fd-b2a4-4ad1-90c8-7bfe73033047 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.201613 Sep 02 21:29:09.594184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 309/569] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:09 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:10.227375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.228032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.229882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:10.235196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.235683 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.236125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.236821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.237281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.237735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.378861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.387643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d7df25e2-8250-48f6-8c4b-d4967cb760cc tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.164085 Sep 02 21:29:10.388263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 261/570] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:10 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:10.625965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.626737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.635361 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.636252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.636956 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.637954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.638651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.639297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.811724 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.823759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.825403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.826675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da119d50-9c80-469b-abe1-db6485a6e51f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.204738 Sep 02 21:29:10.827526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 310/571] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:10 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:11.411459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:11.442274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:11.442274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=10 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:11.442274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.442274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.442274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.442776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.442776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.442776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.573844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:11.581951 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-860f75c7-5dac-479c-a095-b58d87c7f434 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.174232 Sep 02 21:29:11.582747 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 262/572] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:11 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:11.862616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:11.863366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:11.870741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.871126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.871624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.872340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.872800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.873232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.019484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.028672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.030131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.031279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-69786787-c4c9-457f-942c-9e7c3786d5f0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.172647 Sep 02 21:29:12.031835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 311/573] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:11 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:12.605153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:12.605808 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:12.612979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.613474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.613954 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.614662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.615122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.615553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.748205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.756078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e5c9f79b-f940-4b7d-9faa-cff2e965c579 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.154852 Sep 02 21:29:12.756949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 263/574] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:12 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:13.068369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:13.070496 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:13.086691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.087302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.087820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.088622 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.089157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.089660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.226042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.235230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.236582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.237809 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c8b2f046-2ef1-44e6-ab1b-41bc73dd9d49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.173300 Sep 02 21:29:13.238357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 312/575] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:13 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:13.781456 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:13.782490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:13.794089 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.800541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.800541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.800541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.800541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.801968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.965219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.973356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-980bc0db-1ba5-43c1-905e-27173a71e4b6 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.195710 Sep 02 21:29:13.973972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 264/576] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:13 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:14.264707 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:14.266089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:14.274563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:14.317779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:14.317779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:14.317779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:14.317779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:14.318925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:14.432879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:14.444478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:14.446003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:14.447246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a1a5601-98da-452e-b412-8b4d837f2652 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.187870 Sep 02 21:29:14.447891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 313/577] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:14 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:15.001348 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:15.002387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:15.013742 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.014525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.015023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.016222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.016855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.017535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.173941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.182958 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ca42dc5-0ec2-4549-b148-3d79a9f94960 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.188401 Sep 02 21:29:15.183653 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 265/578] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:14 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:15.474801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:15.475477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:15.482151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.482640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.483074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.483777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.484227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.484646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.642161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.652043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.653498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.654780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-eeae2592-89ac-454b-8ec6-aa5d9174f846 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.183912 Sep 02 21:29:15.656022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 314/579] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:15 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:16.212277 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:16.216759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:16.225021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.226696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.227455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.228720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.229616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.230355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.417520 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.425845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-58d48c4f-844e-4ed0-ab7d-a0d92338c596 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.221255 Sep 02 21:29:16.426479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 266/580] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:16 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:16.683999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:16.684629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:16.691137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.691644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.692090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.692816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.693274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.693704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.936468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.936468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.936879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.936879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4d0749af-ce12-4551-adf8-4b7c54a460c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.242295 Sep 02 21:29:16.936879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 315/581] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:16 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:17.453911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:17.454605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:17.470190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.470720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.471168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.472037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.472503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.472936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.605558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:17.613438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-09092015-2ac2-41f6-b693-2fdb35f1d485 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.167373 Sep 02 21:29:17.614058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 267/582] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:17 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:17.952773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:17.953382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:17.960238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.960720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.961150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.961874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.962322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.967501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.098812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.108799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.110289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.111476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1b56c9d9-eca6-42eb-a630-81b4d7742b73 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.162705 Sep 02 21:29:18.112046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 316/583] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:17 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:18.637101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:18.637826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:18.644204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.644694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.645173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.645916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.646378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.646811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.796895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.812719 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a295b945-1555-4caa-b4bb-68f37c536103 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.176134 Sep 02 21:29:18.815424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 268/584] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:18 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:19.137995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:19.138888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:19.145466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.145984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.146417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.147114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.147620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.148046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.153101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:19.299140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:19.311121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:19.313126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:19.314379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a6df6a7d-222d-4c8b-9049-7ebe8a45eb66 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.180407 Sep 02 21:29:19.315432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 317/585] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:19 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:29:19.841794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:19.842468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:19.844805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:19.849843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.850367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.851847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.852565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.853028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.853462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:20.003101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:20.011882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-294ca5fb-bdc3-43b7-ae96-3ccbc9c8914d tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.174098 Sep 02 21:29:20.012460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 269/586] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:19 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:20.342076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:20.343579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:20.351960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:20.352460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:20.352904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:20.353629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:20.354173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:20.354553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:20.575166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:20.575166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:20.575426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:20.575426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2d0c39b7-d600-4587-bfca-ef6489d835b8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.181144 Sep 02 21:29:20.575426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 318/587] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:20 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:21.035812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:21.036434 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:21.043377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:21.043867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:21.044310 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:21.045009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:21.045511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:21.045967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:21.187457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:21.197210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e020d454-999f-41ea-a2eb-888223b741ae tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.165317 Sep 02 21:29:21.197873 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 270/588] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:21 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:21.546893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:21.547634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:21.554262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:21.554740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:21.555177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:21.555865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:21.556313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:21.556734 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:21.754078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:21.763754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:21.765206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:21.766443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0ba7c330-2356-4d7c-82c3-53abc903188b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.223516 Sep 02 21:29:21.767011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 319/589] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:21 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:22.222174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:22.222829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:22.229992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:22.230479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:22.230917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:22.231610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:22.232066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:22.232494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:22.664459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:22.673025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3d4573c2-f0a4-46d0-8311-0f12e72e4c17 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.454643 Sep 02 21:29:22.673695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 271/590] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:22 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:22.792624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:22.793194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:22.801673 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:22.802199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:22.802757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:22.803498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:22.803958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:22.804385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:22.941394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:22.951410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:22.952979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:22.954249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f87206c1-c49f-4562-8cc0-59fc49a83885 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.165675 Sep 02 21:29:22.954921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 320/591] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:22 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:23.064197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1541823528", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "networks": [{"uuid": "be8a17af-8679-4036-958b-5fe5d43385a0"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:23.123752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] validate_networks() for [('be8a17af-8679-4036-958b-5fe5d43385a0', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:29:23.492829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:29:23.493421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:29:23.494359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:29:23.494773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:29:23.495346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:29:23.504278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.504764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.505237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:23.505993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.506453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.506882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:23.524363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Getting quotas for project cbffdee4dc4341e4a33fcfe884f28072. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:29:23.528737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Getting quotas for user 50dab514c64d47d095bd6d1ac8ce3b56 and project cbffdee4dc4341e4a33fcfe884f28072. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:29:23.539667 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:29:23.544001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:29:23.695932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:23.696451 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:23.703197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.703681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.704115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:23.704808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.705310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.705886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:23.714812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-60595c2e-9b86-4283-9976-8d674927934b tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653039 Sep 02 21:29:23.714812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 272/592] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:29:23.725379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7d6c6e9e-a550-4203-9752-b0b0c416eadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:23.726121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7d6c6e9e-a550-4203-9752-b0b0c416eadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:23.805253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d6c6e9e-a550-4203-9752-b0b0c416eadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:23.813540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7d6c6e9e-a550-4203-9752-b0b0c416eadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1219 microversion: 2.1 time: 0.091911 Sep 02 21:29:23.814355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 273/593] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:23 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:23.873667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:23.881761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9e1c0871-9a2b-4b8a-9e6b-281457ec2934 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.189824 Sep 02 21:29:23.882335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 321/594] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:23 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:23.980071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:23.980674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:23.986839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.987310 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.987838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:23.988604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:23.989058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:23.989477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:24.128634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:24.138644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:24.140082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:24.141247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bcd07c98-f786-4ab5-a7f9-9883425a9ecc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.165254 Sep 02 21:29:24.141826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 274/595] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:23 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:24.836465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:24.837098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:24.844347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:24.844836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:24.845276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:24.846001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:24.846461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:24.846891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:24.906554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:24.907222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:24.913408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:24.913889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:24.914290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:24.914764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:24.915470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:24.916566 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:24.917004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:24.922475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6d4f6acc-2c74-42b9-9d38-60e0e0b73bcf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1223 microversion: 2.1 time: 0.089850 Sep 02 21:29:24.923051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 322/596] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:24 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:25.059807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:25.067518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-01c550ac-e0dd-4db9-aad2-8791292697fb tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.164920 Sep 02 21:29:25.068088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 275/597] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:24 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:25.167860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:25.168381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:25.174395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:25.174876 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:25.175302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:25.175985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:25.176432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:25.176855 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:25.319954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:25.329106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:25.330563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:25.331781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-12ca9b53-b81b-4265-b384-c44c1f4800a7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.168501 Sep 02 21:29:25.332333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 323/598] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:25 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:25.945775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:25.946384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:25.954857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:25.955355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:25.955785 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:25.956479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:25.956928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:25.957351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:26.025292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:26.033279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f5d47cb8-ae6c-447b-9007-8213888892a8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1223 microversion: 2.1 time: 0.091406 Sep 02 21:29:26.033886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 276/599] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:25 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:26.091118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:26.091731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:26.098229 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:26.098713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:26.099150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:26.099845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:26.100298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:26.100725 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:26.241984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:26.250264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e72532c-71c6-4714-9d6d-d67c245815b2 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.163058 Sep 02 21:29:26.250857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 324/600] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:26 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:26.358341 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:26.358980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:26.366053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:26.366537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:26.366977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:26.367701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:26.368161 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:26.368722 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:26.502868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:26.512701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:26.514193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:26.515381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6810be4c-f746-4e11-8750-1a9cc9a0afd3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.161204 Sep 02 21:29:26.515947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 277/601] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:26 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:27.057554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:27.058202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:27.064269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.064754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.065190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.065937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.066394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.066827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.131724 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:27.140136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-937c6964-9c0b-4850-b13a-915502631ed3 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1223 microversion: 2.1 time: 0.086875 Sep 02 21:29:27.140705 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 325/602] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:27 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:27.274942 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:27.275937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:27.282461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.282950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.283383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.284095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.284549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.285032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.289171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:27.421506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:27.429283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5779978f-4ab9-4463-b872-62f5125a6a53 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.158552 Sep 02 21:29:27.429873 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 278/603] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:27 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:27.541185 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:27.542388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:27.548477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.548963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.549409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.550215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:27.550674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:27.551103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:27.684183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:27.694830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:27.696318 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:27.697489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4bff2d93-749a-4553-b94a-0665dd7ce12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.160372 Sep 02 21:29:27.698297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 326/604] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:27 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:29:28.163666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:28.164286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:28.171271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.171764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.172205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.172906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.173366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.173825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.245841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:28.254250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1b9a70c8-4567-4728-8c98-f1477914fadd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1223 microversion: 2.1 time: 0.094326 Sep 02 21:29:28.260957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 279/605] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:28 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:28.454183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:28.454800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:28.461191 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.461693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.462166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.462867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.464182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.464588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.597516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:28.605940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8c9a39c7-9642-4507-b301-e705d1e830e3 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.156818 Sep 02 21:29:28.606537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 327/606] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:28 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:28.722849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:28.725095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:28.730124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.730604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.731037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.731731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:28.732184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:28.732606 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:28.865586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:28.875531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:28.876983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:28.878176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-92735a6d-aa05-4bfa-8952-1e24d49c5667 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.159204 Sep 02 21:29:28.878741 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 280/607] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:28 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:29.278242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:29.278854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:29.284885 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.285372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.285838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:29.286542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.286997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.287422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:29.355450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:29.363114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c6776af8-500d-4e60-bdc4-7ef2bf685b43 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1215 microversion: 2.1 time: 0.089092 Sep 02 21:29:29.363678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 328/608] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:29 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:29.629451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:29.633851 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:29.638447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.638943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.639390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:29.640100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.640564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.640996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:29.780308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:29.788192 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fbda93c3-e2a1-4940-a43c-9b81e339ec67 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.162598 Sep 02 21:29:29.788797 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 281/609] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:29 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:29.905960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:29.906554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:29.913076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.913550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.914019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:29.914706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:29.915154 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:29.915574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:30.056940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:30.066720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:30.068145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:30.069356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd42d20a-e31c-4f94-a13a-9825d0e0920c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.168112 Sep 02 21:29:30.070130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 329/610] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:29 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:30.387025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:30.387734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:30.394953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:30.395442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:30.395930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:30.396627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:30.397100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:30.397522 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:30.418929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bd19a9-029f-497c-86c6-f16a291ca1b0", "name": "network-vif-plugged", "status": "completed", "tag": "e23c5f7d-dcf6-4425-930d-0463a8573866"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:30.431169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:30.432608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:30.433897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:30.445764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] Creating event network-vif-plugged:e23c5f7d-dcf6-4425-930d-0463a8573866 for instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 on hv-cinder-85221 Sep 02 21:29:30.454255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-45099652-5ff5-4018-b1af-2c42a5ea288c req-1ee4801f-ca8d-4661-8d0f-66534555200e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041973 Sep 02 21:29:30.454951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 330/611] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:30.479810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:30.488728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2c901bc0-f057-4b76-9605-dc4d1a616ab8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1271 microversion: 2.1 time: 0.106342 Sep 02 21:29:30.489469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 282/612] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:30 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:30.815339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:30.820104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:30.822924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:30.823573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:30.824125 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:30.824957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:30.825531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:30.826111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:31.077334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:31.085797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-85e4eff5-c004-40ea-9efd-05b855ae9b6b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.277670 Sep 02 21:29:31.086637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 331/613] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:30 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:31.106943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:31.107565 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:31.115691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:31.116186 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:31.116627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:31.117334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:31.117831 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:31.118464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:31.270365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:31.280832 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:31.282429 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:31.283690 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1fa04bad-ba1a-47d9-8ec0-0e6e65b34487 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.183052 Sep 02 21:29:31.284340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 283/614] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:31 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:31.514926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:31.515575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:31.521691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:31.522209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:31.522654 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:31.523355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:31.523815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:31.524510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:31.676293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:31.684546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dfd1f813-4bd9-4281-b4ce-1ba1a16aa996 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1331 microversion: 2.1 time: 0.174254 Sep 02 21:29:31.685113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 332/615] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:31 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:32.109197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:32.109783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:32.116651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.117169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.117603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.118336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.118793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.119219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.277041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:32.284855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ef73843a-838f-40cd-9ec5-04c1b611ac1c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.179752 Sep 02 21:29:32.287987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 284/616] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:32 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:32.312035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:32.312659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:32.319592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.324906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.324906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.324906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.324906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.325297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.459533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:32.469539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:32.471076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:32.472245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bbc03cd2-0267-4bd0-974a-cd09dbf287b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.166255 Sep 02 21:29:32.472810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 333/617] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:32 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:32.643152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4238447-de09-4d60-acf7-98737a38fbc3", "tag": "3b2bd9f2-e46a-43a6-b160-faa3d8d0df64"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:32.658929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.659382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.659996 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.673101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] Creating event network-changed:3b2bd9f2-e46a-43a6-b160-faa3d8d0df64 for instance b4238447-de09-4d60-acf7-98737a38fbc3 on hv-cinder-85221 Sep 02 21:29:32.678519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-5ea5de0d-97f5-4c7e-8e31-ffee2b5e162f req-4f6787e4-ea02-4658-b48e-25db095f02a9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039447 Sep 02 21:29:32.679125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 285/618] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:32.708619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:32.709237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:32.716073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.716563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.717003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.717729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:32.718207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:32.718634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:32.737397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:32.855010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:32.864013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d72a264b-2a62-4b08-bf9f-b3c4694f27a7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.159212 Sep 02 21:29:32.864601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 334/619] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:32 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:33.311424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:33.312130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:33.320627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.321113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.321553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:33.322300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.323399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.323911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:33.482532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:33.490347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-54156ada-dfe5-4aaa-8873-48c353a7beaa tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1315 microversion: 2.1 time: 0.185043 Sep 02 21:29:33.490926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 286/620] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:33 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:33.502798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:33.503504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:33.511123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.511634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.512084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:33.512847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.513271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.513704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:33.664352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:33.675404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:33.676909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:33.678112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b45c780b-ca28-487b-8a75-e867885a0e2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.179306 Sep 02 21:29:33.678681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 335/621] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:33 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:33.888555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:33.889204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:33.891196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:33.891902 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:33.896876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.897558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.909468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:33.909468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:33.909468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:33.909468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.046962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:34.054874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5222eed9-d093-4779-be38-fc5039f50fc8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.170554 Sep 02 21:29:34.055461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 287/622] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:33 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:34.571735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:34.572369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:34.574818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=70 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:34.579549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.580032 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.580473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.581173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.581633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.582085 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.718695 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:34.726355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-726f6bd0-fd64-48cd-81d8-4f7d18ce6e89 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1464 microversion: 2.1 time: 0.158448 Sep 02 21:29:34.726930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 336/623] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:34 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:34.783162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:34.783655 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:34.790597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.791173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.792392 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.793174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.793707 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.794249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.820266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:34.820884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:34.821421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:29:34.827505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.828000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.828442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.829146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.829609 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.830108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.890169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 21:29:34.890482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Fri Sep 2 21:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 (ip 10.222.0.99) !!! Sep 02 21:29:34.966064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:34.975206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:34.976744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:34.977929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6270b6fb-13fd-4ab7-a1db-cf690c7c8d0c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.276601 Sep 02 21:29:34.978614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 288/624] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:34 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:29:35.080134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:35.080789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:35.086705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:35.087190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:35.087629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:35.088364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:35.089815 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:35.089947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:35.197595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3d9b68fd-0300-4baf-92bd-b5b20dfd0ad4 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "DELETE /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 204 len: 0 microversion: 2.1 time: 0.417766 Sep 02 21:29:35.198585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 337/625] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:29:34 2022] DELETE /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:29:35.207140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:35.207939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:35.216468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:35.216965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:35.217407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:35.218147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:35.218601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:35.219025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:35.224368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:35.239488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-41a980c6-5e74-4331-9ec3-de25d032e022 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.156955 Sep 02 21:29:35.239488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 289/626] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:35 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:35.357970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:35.366160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b3151015-4ed7-410d-a456-b44d765337ab tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.163036 Sep 02 21:29:35.366713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 338/627] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:35 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:36.003117 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:36.003739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:36.010263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.011063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.011264 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.011975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.012437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.012868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.155541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.164665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.172788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.172788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1e9758cd-cfb8-4efa-b0fe-c20bc1a30845 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.168786 Sep 02 21:29:36.172788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 290/628] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:35 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:36.261017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:36.261590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:36.272575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.273077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.273520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.274270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.274997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.275423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.390385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:36.391003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:36.397053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.397555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.398042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.398810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:36.399563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:36.400088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:36.423435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.432445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7aa3f28f-a9a3-45fe-b0f3-19214154d0c1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.175425 Sep 02 21:29:36.432973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 339/629] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:36 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:36.542970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.551501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a90b468-290b-46e6-8b2e-267cc9bda8bf tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.165057 Sep 02 21:29:36.552102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 291/630] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:36 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:37.194384 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:37.194990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:37.201756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.202314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.202784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.203536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.204001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.204459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.336552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.346323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.347951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.348965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-30336b71-5a11-4668-9131-c17a401f0cbc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.158532 Sep 02 21:29:37.349531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 340/631] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:37 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:37.457254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:37.458732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:37.465487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.466291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.466738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.467494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.468044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.468490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.574266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:37.574807 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:37.593176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.593667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.594138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.594839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.595293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.595717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.624466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.635158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-db87f15a-9021-4544-a42a-d95b89b8847c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.181697 Sep 02 21:29:37.636069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 292/632] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:37 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:37.740128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.756295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-42131e1e-7bcf-4fd0-8bec-545562b4ae44 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.185886 Sep 02 21:29:37.756838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 341/633] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:37 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:38.377528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:38.378264 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:38.384559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.385059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.385518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.386511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.386975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.387409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.524909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.534434 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.535904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.537059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3c07baa6-9d33-464f-b461-c85d7f220ee3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.163814 Sep 02 21:29:38.537629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 293/634] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:38 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:38.623151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "name": "network-vif-plugged", "status": "completed", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:38.633496 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.651980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.651980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.651980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] Creating event network-vif-plugged:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:29:38.651980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-c5f420e1-b497-463c-b58b-49bec4c5307d req-faca5401-2601-4d6a-850c-2f413bb8bd9d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Sep 02 21:29:38.651980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 342/635] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:38.659024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:38.659641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:38.665595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.666119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.666564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.667305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.667794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.668949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.783260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:38.783989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:38.791257 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.791749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.795010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.795010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.795010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.795010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.816358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.824706 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-46757710-0176-44df-9942-13b312aa795d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.169028 Sep 02 21:29:38.825287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 294/636] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:38 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:38.925852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.934197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4d98c424-f1bc-4641-9082-9778a52173b0 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.155797 Sep 02 21:29:38.934769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 343/637] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:38 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:39.564511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:39.565149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:39.571586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.572074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.572545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.573274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.573751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.574232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.593044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:39.708451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:39.717285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:39.718824 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:39.719939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f17dd60f-7a78-4967-b106-a1775d186662 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.159377 Sep 02 21:29:39.720502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 295/638] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:39 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:39.848418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:39.849079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:39.856245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.856710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.857190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.857924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.858382 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.858808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.957985 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:39.961365 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:39.965291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.965874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.966315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.967156 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.967748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.968209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.990547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:39.998250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5db480b0-0a28-46b5-87cf-517575d1d6c8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.153552 Sep 02 21:29:39.998820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 344/639] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:39 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:40.100681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:40.109270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a8d35721-6320-434f-af18-0db0fa030432 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.155145 Sep 02 21:29:40.109870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 296/640] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:39 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:40.745073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:40.745691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:40.752701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:40.753202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:40.753657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:40.754407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:40.754858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:40.755296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:40.893596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:40.902526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:40.903967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:40.905117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aaff89a0-dbb3-4e9b-bc40-a5a0f73187b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.164042 Sep 02 21:29:40.905665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 345/641] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:40 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:41.021859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:41.023655 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:41.030075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.030570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.031005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.031705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.032156 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.032577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.132228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:41.132854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:41.143420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.144083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.144992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.146006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.146720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.147239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.202847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:41.211362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-85683a6a-80ff-4332-8420-e68c27dd5a4e tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.193498 Sep 02 21:29:41.212057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 297/642] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:41 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:41.325701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:41.337035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-67dc75f5-b016-495d-a225-6286af73745f tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1470 microversion: 2.1 time: 0.208476 Sep 02 21:29:41.339078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 346/643] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:41 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:41.794976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bd19a9-029f-497c-86c6-f16a291ca1b0", "name": "network-vif-deleted", "tag": "e23c5f7d-dcf6-4425-930d-0463a8573866"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:41.804840 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.805357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.805819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.817918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] Creating event network-vif-deleted:e23c5f7d-dcf6-4425-930d-0463a8573866 for instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 on hv-cinder-85221 Sep 02 21:29:41.823243 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-f883d4bc-1dd9-4eac-9a29-322a43b5dbfc req-a96c5fac-a701-424a-8ae0-b653328171f7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Sep 02 21:29:41.823876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 298/644] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:41.930029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:41.930641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:41.937603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.938101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.938541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.939234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:41.939687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:41.940115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.072978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.084227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.085688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.086889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d2c17e9f-1a41-4318-ae10-a625b87e89b7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.160880 Sep 02 21:29:42.088273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 347/645] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:41 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:42.237012 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:42.238350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:42.244930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.245476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.246904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.248042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.248605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.249219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.367464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:42.368121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:42.375078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.379330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.379330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.379330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.379330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.379713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.391064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.398919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ca6e99f-3dca-45df-80bb-67c48026c3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.166671 Sep 02 21:29:42.399488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 299/646] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:42 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:42.457575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.465942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fed686f3-b35e-4b7d-ac5c-db43a520d62e tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1300 microversion: 2.1 time: 0.102538 Sep 02 21:29:42.466519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 348/647] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:42 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:42.969058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4238447-de09-4d60-acf7-98737a38fbc3", "name": "network-vif-plugged", "status": "completed", "tag": "3b2bd9f2-e46a-43a6-b160-faa3d8d0df64"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:42.978417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.978892 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.979323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.991452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] Creating event network-vif-plugged:3b2bd9f2-e46a-43a6-b160-faa3d8d0df64 for instance b4238447-de09-4d60-acf7-98737a38fbc3 on hv-cinder-85221 Sep 02 21:29:42.996990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-eb6bfb2c-d17d-439d-89fa-2cb54e576062 req-8f92959f-7469-41f8-b18b-7c1dc37c8c9c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Sep 02 21:29:42.997642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 300/648] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:43.113074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:43.113687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:43.120521 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.121347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.121990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.122795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.123590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.124103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.264777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.273984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.275708 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.276877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3b797d38-83a7-48a5-b60e-c96f7d9d21e3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.167875 Sep 02 21:29:43.278883 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 349/649] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:43 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:43.422982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:43.423697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:43.430532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.431020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.431462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.432158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.432615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.433045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.492487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:43.493116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:43.499432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.499926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.500369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.501073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.501528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.501994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.506175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:43.534922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.535151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.535536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.536136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lazy-loading 'fault' on Instance uuid 70bd19a9-029f-497c-86c6-f16a291ca1b0 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:43.587550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.592606 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.600172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-af7724ae-6ac9-4b6e-9f2c-2005f8d2bf54 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1305 microversion: 2.1 time: 0.111272 Sep 02 21:29:43.601151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 350/650] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:43 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:43.604398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b60cb728-81d5-41f9-8750-7fafa12a5bbf tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.185708 Sep 02 21:29:43.604977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 301/651] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:43 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:44.304723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:44.305244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:44.312789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.313269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.313752 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.314445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.314893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.315314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.473625 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.483408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.484871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.486141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1eff62b7-e886-4510-b51b-f90c95ce66b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.185518 Sep 02 21:29:44.486850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 351/652] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:44 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:44.625168 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:44.625807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:44.627772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:44.628381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:44.632548 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.633481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.633692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.634364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.634742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.634876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.635212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.635717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.636120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.641011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.641011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.641011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.669299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.670061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.670714 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.671344 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lazy-loading 'fault' on Instance uuid 70bd19a9-029f-497c-86c6-f16a291ca1b0 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:44.736517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.745625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7c7547fd-4ed6-4ab4-b4b1-d6a58e23d28b tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1305 microversion: 2.1 time: 0.125015 Sep 02 21:29:44.746337 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 302/653] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:44 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:44.799139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.806841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-abc4ee41-8443-470f-a20c-5c3b09ed69fd tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.183268 Sep 02 21:29:44.807480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 352/654] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:44 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:45.511655 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:45.512459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:45.518593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.519086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.519526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.520251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.520716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.521126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.657512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.666349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.668587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.669600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eab5cffe-1d88-4ff4-955c-ad4ef1111a7a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1807 microversion: 2.20 time: 0.161959 Sep 02 21:29:45.670198 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 303/655] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:45 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:45.768710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:45.769331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:45.771674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 21:29:45.771904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Fri Sep 2 21:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 (ip 10.222.0.99) !!! Sep 02 21:29:45.785670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.786193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.786634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.787351 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.787814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.788244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.823685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.824404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.824770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.825584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lazy-loading 'fault' on Instance uuid 70bd19a9-029f-497c-86c6-f16a291ca1b0 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:45.832753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:45.833367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:45.844140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.844631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.845067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.845784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.846296 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.846719 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.871798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f0dd60f95b442aa893f1a1eda4e275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ed0de2b2bf4173919e3ed69467f408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.879615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-99396c9f-39c4-4922-a04d-56764cf8bed9 tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 200 len: 1305 microversion: 2.1 time: 0.114967 Sep 02 21:29:45.880186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 353/656] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:45 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:45.990855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.999304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9899e23e-460e-4a6d-9f79-ed389101bb68 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1319 microversion: 2.1 time: 0.170562 Sep 02 21:29:45.999885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 304/657] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:45 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:46.696083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:46.696335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:46.705775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.706271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.707005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:46.707737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.708198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.708634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:46.855960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:46.864845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:46.866254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:46.867413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-34c1f669-dc95-46d1-996a-9cbac39f0bd7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1794 microversion: 2.20 time: 0.175855 Sep 02 21:29:46.867963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 354/658] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:46 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1794 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:29:46.902924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:46.903563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] [instance: 70bd19a9-029f-497c-86c6-f16a291ca1b0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:46.910063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.910550 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.910994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:46.911693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.912153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.912586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:46.926545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] HTTP exception thrown: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Request method failure captured: Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 HTTP/1.1 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnWXaxopBUSQ4LFFcBPWso3U74_qQUsqDaY4CCwYiV1dSHMy6ryURt9GJ85fMLpnZ6CurDpWRBD-7F8LY6XoMaPW9rQSfQ4gZ8BVXx57golTuF89axmEwZEBwwfmLlEYmtSPvK0MBj_g9S5rHlAfx9zChT2fjMpaU2aRvg8Pkm8Vemk Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 99ed0de2b2bf4173919e3ed69467f408 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesNegativeTest-657313157 Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:29:46.928183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/99ed0de2b2bf4173919e3ed69467f408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/99ed0de2b2bf4173919e3ed69467f408"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/99ed0de2b2bf4173919e3ed69467f408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_99ed0de2b2bf4173919e3ed69467f408", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesNegativeTest-657313157 Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 99ed0de2b2bf4173919e3ed69467f408 Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesNegativeTest-657313157 Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesNegativeTest-657313157-project Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: f7f0dd60f95b442aa893f1a1eda4e275 Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesNegativeTest-657313157-project Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. Sep 02 21:29:46.930092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '70bd19a9-029f-497c-86c6-f16a291ca1b0'} Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:29:46.930926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. Sep 02 21:29:46.932171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:29:46.933281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] Returning 404 to user: Instance 70bd19a9-029f-497c-86c6-f16a291ca1b0 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:29:46.933281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eaba0afa-bc50-4204-a003-6b7077a71c2c tempest-VolumesNegativeTest-657313157 tempest-VolumesNegativeTest-657313157-project] 10.222.0.99 "GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0" status: 404 len: 111 microversion: 2.1 time: 0.030906 Sep 02 21:29:46.933281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 305/659] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:46 2022] GET /compute/v2.1/servers/70bd19a9-029f-497c-86c6-f16a291ca1b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:29:47.022023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:47.022640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:47.029096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:47.029582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:47.030163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:47.030981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:47.031449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:47.031880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:47.164268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:47.172863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f9491d95-4f7d-4bf5-94d8-51500e320cd8 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1508 microversion: 2.1 time: 0.154721 Sep 02 21:29:47.173440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 355/660] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:47 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:47.196763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "800c1f82-41f9-4854-bb0a-7ae92aef9ca9", "device": "/dev/sdb"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:47.199953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:47.206111 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:47.206592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:47.207021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:47.207710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:47.208332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:47.208756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:48.225498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7ba147c4-a84e-4651-8584-8523953a674d tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "POST /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032637 Sep 02 21:29:48.230293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 306/661] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:29:47 2022] POST /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3/os-volume_attachments => generated 194 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:55.666018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c32ad7e-7528-48de-86f9-3a21d42cba25"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:55.666018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:55.671761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:55.672241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:55.672674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:55.673368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:55.673955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:55.674336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.794324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-12f1798d-bcb9-474d-abd1-d97a2e4e06bf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.389443 Sep 02 21:29:56.795594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 356/662] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:29:55 2022] POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments => generated 194 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:01.557134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:01.557978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:01.562202 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:01.562830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:01.569283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.569820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.570255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.570959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.571444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.571868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.599270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2b89d8cb-5126-4fc8-9c4f-14911fe5bc05 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/ips" status: 200 len: 149 microversion: 2.1 time: 0.043767 Sep 02 21:30:01.599876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 307/663] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:30:01 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:04.499120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92baa626-20d1-4d34-adb5-39d590afcb9d"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:04.501558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:04.507925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.508415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.508887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.509603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.510084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.510510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:05.414148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e201c4fa-5ad6-43ee-ba74-68ed5fdce49d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920644 Sep 02 21:30:05.415112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 357/664] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:30:04 2022] POST /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:11.984788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:11.987250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:11.995820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:11.996385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:11.996834 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.000590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:12.000590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:12.000590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.023037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'flavor' on Instance uuid 5b88b58d-da51-49e3-8cd2-622325c153a7 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:12.465619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4974a621-c7e6-49aa-8800-a57401ca194b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/action" status: 200 len: 32 microversion: 2.1 time: 0.485023 Sep 02 21:30:12.466488 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 308/665] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:30:11 2022] POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:30:12.477939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:12.478682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:12.481525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:12.497065 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:12.498015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:12.498468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.499178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:12.500441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:12.500944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.661238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:12.664665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e4ea882a-0195-4e47-84f9-86734f771122 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.191252 Sep 02 21:30:12.665516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 358/666] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:12 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:13.691082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:13.691786 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:13.698569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:13.699079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:13.699553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:13.700302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:13.700765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:13.701194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:13.840989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:13.851895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4c098c8-33f3-4bb3-ae4a-233d61feb44b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.165793 Sep 02 21:30:13.852490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 309/667] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:13 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:14.877432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:14.878420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:14.880303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:14.881033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:14.885230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.885820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.886256 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.886991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.887461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.887746 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.887933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.888262 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.888700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.889411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.889900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.890924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.893143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:15.002543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'services' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:15.054102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:15.068612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b1207556-74d3-49c7-a12c-28c0b75724d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.195921 Sep 02 21:30:15.076060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 359/668] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:14 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:15.261520 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3da586cc-10df-4705-b8f2-800197977386 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3/os-volume_attachments/800c1f82-41f9-4854-bb0a-7ae92aef9ca9" status: 202 len: 0 microversion: 2.1 time: 0.385568 Sep 02 21:30:15.262403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 310/669] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:30:14 2022] DELETE /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3/os-volume_attachments/800c1f82-41f9-4854-bb0a-7ae92aef9ca9 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:30:16.094971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:16.095874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:16.102700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.103195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.103649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.104343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.104805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.105240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.287643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:16.296555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-134cb162-4ac9-479b-8e89-535b80f9c2d1 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.206124 Sep 02 21:30:16.297160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 360/670] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:16 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:17.327432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:17.328235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.334875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.335381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.335830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.336616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.337079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.337514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.519787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.528696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-73213ae4-f2ac-4df5-8f02-47f7a9e8976c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.207662 Sep 02 21:30:17.529291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 311/671] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:17 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:17.947152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:17.951128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.953847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.954339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.954774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.955468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.955923 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.956347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.095169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lazy-loading 'services' on Instance uuid ff2f4ef0-ee14-44b1-aced-1da687734ffa {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:18.398203 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-34426b21-068b-4835-8678-62a77cf289a2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments/c7d85879-2c91-49ee-9bec-6aec2832f804" status: 202 len: 0 microversion: 2.1 time: 0.564209 Sep 02 21:30:18.398723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 361/672] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:30:17 2022] DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments/c7d85879-2c91-49ee-9bec-6aec2832f804 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:18.552782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:18.553432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:18.559937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.560418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.560855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.561542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.562025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.562955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.705461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:18.714329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7a17877a-9a0f-4f86-8b7d-94a205895ee6 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.165247 Sep 02 21:30:18.715023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 312/673] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:18 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:19.738745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:19.739366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:19.746791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.747279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.747729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.748440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.748902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.749339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.887237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.896430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-17faaa0f-584b-4754-8a23-e3d67bc3e1c0 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.162059 Sep 02 21:30:19.897005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 362/674] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:19 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:20.546119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4a582c37-f6c7-4532-a6db-941767f6aaff tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: .version_select at 0x7faac0d770d0>, body: {"keypair": {"name": "tempest-keypair-508569582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg+YJZ0H/SKbdEJp6tAorbS5NAJT/mLCYkFf4htne3RJiv6tHaOpLWklEAEY5l8QxOlrkmCX/7IbFWNb0c76Zt8see4KZ/7+xZcJxuEnbL+XeGn5XyFd1RBZ8qmm8HD2Q=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:20.571036 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-4a582c37-f6c7-4532-a6db-941767f6aaff tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:30:20.575564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-4a582c37-f6c7-4532-a6db-941767f6aaff tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:30:20.692080 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4a582c37-f6c7-4532-a6db-941767f6aaff tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151399 Sep 02 21:30:20.692728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 313/675] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:30:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:20.924195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:20.924195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:20.928595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.929095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.929571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.930282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.930744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.931184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.105928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:21.115737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-11cbef74-87b9-44e7-a912-09f6604e8de5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.198967 Sep 02 21:30:21.116324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 363/676] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:20 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:21.757082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:21.757632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:21.764259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.764737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.765245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.766587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.767235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.767665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.794657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:30:22.153422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:22.154298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:22.163958 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.164452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.164897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.165612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.166609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.166748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.313400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9cee452-b07e-47c5-8ce3-dab3542a1a6c tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 204 len: 0 microversion: 2.1 time: 0.559451 Sep 02 21:30:22.314580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 314/677] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:30:21 2022] DELETE /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:22.317938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.325045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:22.325862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:22.328965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-474650cb-8aa1-4af0-b978-cb980a8ab20e tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.179692 Sep 02 21:30:22.329744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 364/678] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:22 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:22.336593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.337203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.337801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.338608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.339167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.339721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.486603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.494735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3bef1c98-f745-4944-92d4-0213a92133aa tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1514 microversion: 2.1 time: 0.174364 Sep 02 21:30:22.495952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 315/679] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:22 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:22.751605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:22.757694 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.758225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.758680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.783356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Going to try to stop instance {{(pid=121276) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 21:30:23.161926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d186e2f5-62d4-44db-ad11-23dd5541a083 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.414092 Sep 02 21:30:23.165614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 365/680] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:30:22 2022] POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:23.171124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.171900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.181859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.182366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.182812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.183532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.183995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.184815 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.332820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.343027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-94c5d4cb-d69d-4fb8-8e44-46dc1786d1e2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1723 microversion: 2.1 time: 0.175981 Sep 02 21:30:23.343665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 316/681] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:23.354183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.355252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.362584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.371578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.371578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.371578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.371578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.372018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.520027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.520662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.521894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.538598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.538598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.538598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.538598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.538959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.538959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.539124 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c1127cdc-5234-444e-8cb4-5f7437053f48 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.181403 Sep 02 21:30:23.539124 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 366/682] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:23.658345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1211095122", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "315bf927-f303-4323-bf17-32171d1e63b8"}], "security_groups": [{"name": "tempest-securitygroup--886342418"}], "key_name": "tempest-keypair-508569582", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:23.695236 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.703518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-95fd501b-bc30-4d92-9e1a-ff2392331d2a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1514 microversion: 2.1 time: 0.187806 Sep 02 21:30:23.704141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 317/683] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:23.774214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] validate_networks() for [('315bf927-f303-4323-bf17-32171d1e63b8', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:30:24.241340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:30:24.242012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:30:24.242304 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:30:24.242854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:30:24.243309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:30:24.253892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.254397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.254995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.255749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.256215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.256649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.275674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:30:24.280021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:30:24.293683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:30:24.296036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:30:24.368487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.369781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.382530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.383026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.383475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.384244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.384706 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.385411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.456475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3e5b2f8a-68ec-4c81-a9f7-c4c33dc9bd0c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.803660 Sep 02 21:30:24.457530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 367/684] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:30:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:30:24.471207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8482dc9f-b665-4901-b80a-3e5f52310bcd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.472162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8482dc9f-b665-4901-b80a-3e5f52310bcd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.556408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8482dc9f-b665-4901-b80a-3e5f52310bcd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:24.566046 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8482dc9f-b665-4901-b80a-3e5f52310bcd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1241 microversion: 2.1 time: 0.100481 Sep 02 21:30:24.567321 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 368/685] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:24.572502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.573401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.582470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.583224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.583847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.584967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.585619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.586395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.593540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:24.602281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9c031a30-ca31-4d75-863b-140decee0035 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.237681 Sep 02 21:30:24.603234 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 318/686] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:24.737372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.738330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.746649 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.747250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.747783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.749322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.749975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.751175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.074379 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.083666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.086983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b962b8cf-2326-41a6-8db9-72f2ca367f38 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.518389 Sep 02 21:30:25.087594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 369/687] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:25.102345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-373d74c7-08a5-412a-a255-16a7e5e5a3ad tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1514 microversion: 2.1 time: 0.371457 Sep 02 21:30:25.103019 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 319/688] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:25.600592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:25.601163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:25.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.610053 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.610258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.610887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.611346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.611772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.635598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:25.636733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:25.645229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.645758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.646576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.647616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.648263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.648696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.674392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:25.688464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.696597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f77da00e-3e51-48f7-a0c8-a2fb3c38c917 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1245 microversion: 2.1 time: 0.100371 Sep 02 21:30:25.697195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 370/689] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:25 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:25.835773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.845571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e68dfa98-74b7-4f6f-a169-a84d3c18e9bc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.222377 Sep 02 21:30:25.846418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 320/690] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:25 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:26.111931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.112727 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.120213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.120796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.121307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.122265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.122731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.123161 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.136178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4238447-de09-4d60-acf7-98737a38fbc3", "name": "network-vif-deleted", "tag": "3b2bd9f2-e46a-43a6-b160-faa3d8d0df64"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:26.148903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.149674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.150189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.163569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] Creating event network-vif-deleted:3b2bd9f2-e46a-43a6-b160-faa3d8d0df64 for instance b4238447-de09-4d60-acf7-98737a38fbc3 on hv-cinder-85221 Sep 02 21:30:26.169175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a7aefc3c-ba14-4c6c-aacc-074a479384bd req-59972519-1e83-4e13-8e71-4fd569f440fa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100688 Sep 02 21:30:26.175221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 371/691] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:26.176619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.177356 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.189532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.190184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.190520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.191431 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.191894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.192329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.279176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.288335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-831e8aca-5128-4220-8036-74684d89299f tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1472 microversion: 2.1 time: 0.117334 Sep 02 21:30:26.288934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 372/692] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:26.332917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.341780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-21bc1915-f229-4232-8cb0-4aa87e7afefc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.234137 Sep 02 21:30:26.342430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 321/693] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:26.721910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.722557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.729234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.729751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.730198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.730903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.731363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.731790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.796513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.806144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9cee1ec0-7d81-4980-a0a7-b4b138430f76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1245 microversion: 2.1 time: 0.088799 Sep 02 21:30:26.817884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 373/694] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:26.876866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.877528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.884360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.884853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.885501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.886252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.886712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.887146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.025396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.034960 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c018d86e-f158-47c3-accc-e096d0404f02 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.162584 Sep 02 21:30:27.035722 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 322/695] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:27.314397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:27.315055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:27.321891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.325135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.325135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.325135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.325135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.325630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.366506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:27.367509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:27.373891 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.374599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.375976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.376866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.377501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.378115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.393006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.401510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0913c694-40de-4ca0-85b1-3821c4c47592 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1304 microversion: 2.1 time: 0.091765 Sep 02 21:30:27.403160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 374/696] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:27 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:27.533349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.542238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c916d471-a057-4c86-875c-84e5523ea52b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.179784 Sep 02 21:30:27.554313 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 323/697] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:27 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:27.829877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:27.831114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:27.838652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.839145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.839610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.840314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.840769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.841240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.905849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.914482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-61243bb9-362b-49b4-8229-4068586fddb3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1237 microversion: 2.1 time: 0.089700 Sep 02 21:30:27.915061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 375/698] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:27 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:28.061317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.061989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.068569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.069053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.069496 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.070229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.070693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.071153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.222595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.230627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cd87cb3c-21b4-4f6d-96a0-1f24e3797441 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.173223 Sep 02 21:30:28.231218 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 324/699] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:28.425796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.426330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.432567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.433092 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.433539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.434296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.434749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.435179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.449928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:28.465994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.466478 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.466926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.467369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:28.508645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.516706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b01f842a-3851-422f-90ff-19550a40e607 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.095541 Sep 02 21:30:28.517270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 376/700] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:28.566706 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.567323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.573385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.573916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.574367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.575065 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.575525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.575956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.714209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.723552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-10dc8b51-ccd5-41bf-8301-467f41d25d34 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1737 microversion: 2.1 time: 0.160751 Sep 02 21:30:28.724146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 325/701] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:28.938810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.939532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.946383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.946865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.947304 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.948014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.948468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.948904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.024170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:29.032859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c7e9a48c-6707-49c0-8651-45c45f090b70 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1237 microversion: 2.1 time: 0.099007 Sep 02 21:30:29.033453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 377/702] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:29.265210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.267110 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.274108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.274614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.275064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.275793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.276351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.276976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.423855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:29.432144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-748970e8-277e-42f7-a608-cf5536306c67 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.170775 Sep 02 21:30:29.437166 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 326/703] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:29 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:29.540935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.541464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.548249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.548733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.549173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.549903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.550368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.550798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.584746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.585255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.585698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.586189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:29.628410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:29.636116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a737c63-ab4e-412d-beb5-0dc4b8561935 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.099483 Sep 02 21:30:29.636701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 378/704] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:29 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:29.747218 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.747822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.754476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.754959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.755424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.756107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.756563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.756986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.895497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:29.903977 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-524a4926-b090-4cc2-b59e-25a8f78228dd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1717 microversion: 2.1 time: 0.160668 Sep 02 21:30:29.904489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 327/705] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:29 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:29.967875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.968393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.975710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.976435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.977029 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.977772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.978236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.978671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.056448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:30.056978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.067074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.075360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.075360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.075360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.075360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.075713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] HTTP exception thrown: Cannot 'detach_volume' instance 5b88b58d-da51-49e3-8cd2-622325c153a7 while it is in vm_state rescued Sep 02 21:30:30.075805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Request method failure captured: Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments/7c32ad7e-7528-48de-86f9-3a21d42cba25 HTTP/1.1 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSRpvEcdPnGtprDf5fO7SZYQkmKMkufJPNA5HvOGKgMUGPHY_jUNscYa1CTrrjnk8XAtzr43uE_WGTXyRKE_lXJCTVxN-dZh9Hp5Qx0sjHvJ2VvBZV2BJ3bZXlysQ71apox1y6RMxV1WB48xGDtQUSMcysCJcSbnx6YAaXzvrKwEdM Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 786534cce098405196143139d375b465 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:30:30.075893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/786534cce098405196143139d375b465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_786534cce098405196143139d375b465", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 786534cce098405196143139d375b465 Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: dc0bc75b6b3f4d1689bc1f7faaa2e5bc Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:30:30.077151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Cannot 'detach_volume' instance 5b88b58d-da51-49e3-8cd2-622325c153a7 while it is in vm_state rescued Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'server_id': '5b88b58d-da51-49e3-8cd2-622325c153a7', 'id': '7c32ad7e-7528-48de-86f9-3a21d42cba25'} Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:30.077859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5b88b58d-da51-49e3-8cd2-622325c153a7 while it is in vm_state rescued Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5b88b58d-da51-49e3-8cd2-622325c153a7 while it is in vm_state rescued Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:30:30.079167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Returning 409 to user: Cannot 'detach_volume' instance 5b88b58d-da51-49e3-8cd2-622325c153a7 while it is in vm_state rescued {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:30.080173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0bfa96f0-b3b3-44a9-909e-7cb96efb4ebc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments/7c32ad7e-7528-48de-86f9-3a21d42cba25" status: 409 len: 152 microversion: 2.1 time: 0.108984 Sep 02 21:30:30.080173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 379/706] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:30:29 2022] DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments/7c32ad7e-7528-48de-86f9-3a21d42cba25 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 21:30:30.081196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:30.081607 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.089865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.090365 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.090808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.091522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.091978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.092402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.138095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.146216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4eb8d6b3-9daf-49d3-9124-80a512165649 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1237 microversion: 2.1 time: 0.093545 Sep 02 21:30:30.146809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 328/707] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:30 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:30.317565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dee34d77-60df-46dc-9608-f4f341b5fdfc tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/action" status: 202 len: 0 microversion: 2.1 time: 0.239975 Sep 02 21:30:30.318183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 380/708] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:30:30 2022] POST /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:30.326580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:30.327383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.334012 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.334503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.334955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.335676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.336114 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.336547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.457333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:30.458293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.464723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.465215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.465652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.466388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.466838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.467280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.478660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.489931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-790f76dd-f683-416e-9555-8e09766e6056 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1725 microversion: 2.1 time: 0.167087 Sep 02 21:30:30.490946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 329/709] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:30 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:30.625624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.636079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-10c0930d-70b7-4a61-8ade-0968608a0d2c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.183262 Sep 02 21:30:30.637023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 381/710] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:30 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:30.666665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:30.668968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.680290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:30.684260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.685096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.685703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.687134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.687726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.688383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.723279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.723781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.724229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.724692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:30.769857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.779936 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1358a208-698c-4450-b401-196aacee3ee1 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.120754 Sep 02 21:30:30.787278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 330/711] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:30 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:31.171283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.171962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.178831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.179308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.179746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.180454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.180912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.181336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.262378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.275585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c353bbe4-60ea-445f-b7bc-c5bd7c51fd78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1293 microversion: 2.1 time: 0.109086 Sep 02 21:30:31.285882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 382/712] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:31.515369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.516696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.523394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.525354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.525858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.526567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.527285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.533118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.663221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.664908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.672276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.676524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.676524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.676524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.676524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.676989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.687249 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.711933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8c3ac8e8-36df-4670-82fe-06df338c221c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1725 microversion: 2.1 time: 0.200964 Sep 02 21:30:31.714363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 331/713] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:31.804215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.804910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.811275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.811766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.812238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.814427 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.814916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.815526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.839875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.840658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f3846891-4c00-4ac3-b71e-50909ce14fb8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.184562 Sep 02 21:30:31.841249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 383/714] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:31.849536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.850205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.856562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.856562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:31.893544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.901567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-682d6991-0233-47e1-b013-f9fa3425d17a tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.101228 Sep 02 21:30:31.902240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 332/715] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:32.298519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:32.299139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:32.305672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.306212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.306651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.307361 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.307939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.308255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.379035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.387056 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-022803f3-c154-4c2f-b3aa-a1458b8c44c0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1311 microversion: 2.1 time: 0.092612 Sep 02 21:30:32.387624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 384/716] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:32 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:32.738550 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:32.739160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:32.746030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.746512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.746940 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.747626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.748088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.748552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.865493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:32.866556 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:32.872505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.873083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.873595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.874411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.875538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.876010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.884094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.893834 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-104772e9-3778-4961-8cb3-f8ffd71f5ae8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1725 microversion: 2.1 time: 0.159415 Sep 02 21:30:32.894440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 333/717] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:32 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:32.925020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:32.925646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:32.932049 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.932692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.933243 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.933968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.934631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.935072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.975467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.975467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.975467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.975467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:33.035619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.051403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8bc95db3-c3e3-42d2-9998-02778d1c0cc7 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.130659 Sep 02 21:30:33.052386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 334/718] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:32 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:33.061488 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.070916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-79619ba9-8128-4c24-98e3-2d35f4302de4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.209509 Sep 02 21:30:33.071614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 385/719] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:32 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:33.411954 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:33.412570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:33.418782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.420800 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.420800 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.420800 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.421075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.421430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.486684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.494556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2aaa3a7e-3c41-4261-9cd7-b8200735bf80 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1311 microversion: 2.1 time: 0.086580 Sep 02 21:30:33.495143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 335/720] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:33 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:33.918741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:33.919290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:33.926072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.926558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.926988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.927730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.928135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.928557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.081470 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:34.082758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:34.096348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:34.098317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.100247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.100900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.103615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.104271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.104871 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.110941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:34.111888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-024913ee-3750-4787-ab4a-368e3cf387a2 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1725 microversion: 2.1 time: 0.196367 Sep 02 21:30:34.112507 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 386/721] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:33 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:34.118405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:34.119018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:34.129533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.130081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.134371 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.135207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.136597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.137907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.158621 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.159232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.159771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.160262 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lazy-loading 'fault' on Instance uuid b4238447-de09-4d60-acf7-98737a38fbc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:34.268957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:34.279360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50dab514c64d47d095bd6d1ac8ce3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbffdee4dc4341e4a33fcfe884f28072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:34.290068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-601f379c-ca8e-4310-8433-bcc502bd7613 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 200 len: 1309 microversion: 2.1 time: 0.216790 Sep 02 21:30:34.290864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 336/722] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:34 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 1309 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:34.359481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:34.368048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a67878ab-c45a-4b3a-aa8b-5c31b7da0745 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1677 microversion: 2.1 time: 0.254397 Sep 02 21:30:34.369664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 387/723] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:34 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:34.520659 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:34.521283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:34.527997 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.528492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.528931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.529640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.530126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.530556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.704358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:34.718331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5763e15a-6084-4ed7-bb01-8ffe015c5e77 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.200476 Sep 02 21:30:34.718331 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 337/724] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:34 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:35.137811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:35.138551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:35.140965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=8 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:35.147270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.148387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.148922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.149922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.150586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.151187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.310249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:35.316417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:35.317818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] [instance: b4238447-de09-4d60-acf7-98737a38fbc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:35.322809 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-30fd1312-632f-407f-a907-822c7f99bf99 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1731 microversion: 2.1 time: 0.187875 Sep 02 21:30:35.324241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 388/725] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:35 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:35.331170 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.331823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.332562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.334189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.334852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.335361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.357208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] HTTP exception thrown: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Request method failure captured: Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 HTTP/1.1 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUj876_BTZWs4duNHtOwQIq3Ph9rWtKXiA1ZVxePOrp-jSQSZOeNxe0l9zkhSuvW3HkarxRm_bnlwqv_n56m92gGvlPd1jQHhtaflywwy4CIhgqnWkNpdHv8f3LNvB4lZPJj58LHRzRq6_icnGyeSw4o5OywuNLG-RXnq0YaIDuQB0 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: cbffdee4dc4341e4a33fcfe884f28072 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:30:35.359695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cbffdee4dc4341e4a33fcfe884f28072"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cbffdee4dc4341e4a33fcfe884f28072", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: cbffdee4dc4341e4a33fcfe884f28072 Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1694924172 Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesSnapshotTestJSON-1694924172-project Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 50dab514c64d47d095bd6d1ac8ce3b56 Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesSnapshotTestJSON-1694924172-project Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. Sep 02 21:30:35.362294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'b4238447-de09-4d60-acf7-98737a38fbc3'} Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:35.363302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. Sep 02 21:30:35.365545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:30:35.380607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] Returning 404 to user: Instance b4238447-de09-4d60-acf7-98737a38fbc3 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:35.380795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:35.380895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-144cfc35-b025-43bf-a508-bb0f3dd2ce14 tempest-VolumesSnapshotTestJSON-1694924172 tempest-VolumesSnapshotTestJSON-1694924172-project] 10.222.0.99 "GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3" status: 404 len: 111 microversion: 2.1 time: 0.049976 Sep 02 21:30:35.380993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:35.381092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 338/726] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:35 2022] GET /compute/v2.1/servers/b4238447-de09-4d60-acf7-98737a38fbc3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:35.381176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.381176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.381176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.381176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.381513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.381513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.395322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:35.395969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:35.408203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.409086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.409086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.410727 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.411281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.411721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.529703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bd748094-8931-43d3-bf54-1be6a47df2a5 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182615 Sep 02 21:30:35.530677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 389/727] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:30:35 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:35.748551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:35.750352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:35.757280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.757825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.758272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.758995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.759677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.760403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.786144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:35.805125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b6326b51-4a0a-409b-9768-1420c7fd3472 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1654 microversion: 2.1 time: 0.415839 Sep 02 21:30:35.806660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 339/728] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:35 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1654 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:35.834074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:35.846961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:35.847881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:35.848830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.914895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Going to try to start instance {{(pid=121277) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 21:30:36.096454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:36.108419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a1b35f9-19d2-4cf7-9794-3de374525842 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.363869 Sep 02 21:30:36.109745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 390/729] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:35 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:36.242171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-37942d88-2445-4557-910a-794167d5ba5d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.410011 Sep 02 21:30:36.247147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 340/730] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:30:35 2022] POST /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:36.254624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:36.256479 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:36.268013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.268794 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.269403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.270582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.271255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.271898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.312005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d45104-6397-4740-ad90-b74822d88474", "tag": "2597c8d6-b463-450f-a8ab-cecf96eb5db0"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:36.332495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.332495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.332495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.358540 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] Creating event network-changed:2597c8d6-b463-450f-a8ab-cecf96eb5db0 for instance d6d45104-6397-4740-ad90-b74822d88474 on hv-cinder-85221 Sep 02 21:30:36.384213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-b0445d1c-1d4e-462b-bbf4-963cc5783f00 req-a6fe7f1b-cf18-4ef0-b512-bb0bd3b94899 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074117 Sep 02 21:30:36.400055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 341/731] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:36.553357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:36.557564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:36.570679 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ac6c0ecd-0b97-4415-8f46-e7b3305d8557 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.322636 Sep 02 21:30:36.572558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 391/732] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:36 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:37.140311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:37.142662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:37.150350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.151200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.151807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.152960 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.153614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.154234 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.302072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:37.325740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.332538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.332538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.342227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] Creating event network-changed:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:30:37.349282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-5f61a918-ffa5-46db-b8e5-c678aa9cd537 req-f9474fbd-970c-4dd2-bb63-df783943ec6f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161435 Sep 02 21:30:37.350436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 392/733] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:37.402291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:37.412081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6aa67504-9bff-4306-b8d5-d598592ee54b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.275735 Sep 02 21:30:37.412938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 342/734] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:37 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:37.607656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:37.609975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:37.629375 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.630813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.631484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.632410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.633279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.633957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.940692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:37.963670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f0fddbd0-9928-467e-a907-9c5b85f9fe8c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.365855 Sep 02 21:30:37.978516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 393/735] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:37 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:38.434926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:38.435820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:38.443930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.444775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.445487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:38.446384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.446935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.447559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:38.610989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:38.619964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8007d177-6e31-4b39-9fd6-cb4f19c37515 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.188778 Sep 02 21:30:38.620573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 343/736] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:38 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:38.989448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:38.990179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:38.997018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.997504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.997978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:38.998681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.999140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.999568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.159151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:39.168004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-85cead48-21be-47b7-a253-e76b823118ea tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.182391 Sep 02 21:30:39.168611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 394/737] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:38 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:39.365176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:39.371455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:39.375804 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.376279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.383886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.391376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] Creating event network-changed:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:30:39.396621 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-ad1dcfc4-9823-4f6b-8ee3-a640c2470f6c req-acc2572e-4f71-45a8-be94-00fb8eb099b7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Sep 02 21:30:39.397226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 344/738] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:39.644981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:39.645584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:39.651730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.652602 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.653031 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.653737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.654220 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.654650 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.798062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:39.805885 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3aa789eb-1a98-44af-b66b-9bcaf125f2f0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.165208 Sep 02 21:30:39.806470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 395/739] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:39 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:40.195669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:40.196297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:40.204019 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:40.206029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:40.206029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:40.206029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:40.206332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:40.206599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:40.353992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:40.363766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a1391f7e-a66f-482b-870b-722bb3525386 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.172867 Sep 02 21:30:40.364338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 345/740] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:40 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:40.830170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:40.830802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:40.837609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:40.838130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:40.838571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:40.839281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:40.839736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:40.840173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:40.979424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:40.989805 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a9047e7-a05d-408f-8108-e515c7c0a861 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.164104 Sep 02 21:30:40.990397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 396/741] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:40 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:41.387034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:41.387646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:41.395352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:41.395933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:41.396377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:41.397086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:41.397581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:41.398058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:41.537159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:41.545042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4e310a1b-cd17-4aeb-9d14-2b610ef2bf1f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.161931 Sep 02 21:30:41.545640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 346/742] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:41 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:42.017335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.017907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.020406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:42.025161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.025634 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.026116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.026806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.027528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.027949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.167217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:42.175759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-424e305d-deed-4e85-b0cf-07b873eb6f4b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.163515 Sep 02 21:30:42.176352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 397/743] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:42 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:42.570794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.571513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.579385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.579983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.580460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.581167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.581628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.582178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.727623 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:42.736887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f0b84712-b038-458d-8911-d69c8afb3dfe tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.169974 Sep 02 21:30:42.737485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 347/744] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:42 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:43.201021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:43.201632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:43.210848 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.211659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.212310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.213037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.213637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.214108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.370148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:43.380066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-40e0707e-5976-4ae0-951c-208460780b94 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.183030 Sep 02 21:30:43.380653 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 398/745] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:43 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:43.760729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:43.761388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:43.768777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.776406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.776406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.776406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.776406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.776759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.911872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:43.919917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7c1e14da-169e-4d13-963b-e31a633d3866 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1663 microversion: 2.1 time: 0.163138 Sep 02 21:30:43.920494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 348/746] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:43 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:44.405348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:44.408061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:44.420270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.421150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.421597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:44.423536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.424032 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.424810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:44.569621 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:44.577548 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fcfe02a9-4840-469c-9fc7-69fc3c272197 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.176411 Sep 02 21:30:44.579510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 399/747] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:44 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:44.944315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:44.944945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:44.954696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.955401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.963289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:44.964149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.964512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.982146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:45.135703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:45.145974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-677ee5e6-9921-4af2-8e8c-466880aa7b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1667 microversion: 2.1 time: 0.204466 Sep 02 21:30:45.146735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 349/748] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:44 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1667 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:45.602673 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:45.603440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:45.613290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:45.613814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:45.614269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:45.615349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:45.615826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:45.616263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:45.928423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:45.939753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-805990f1-8622-41bd-b74b-3ca9fa1bac78 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.341768 Sep 02 21:30:45.953740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 400/749] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:45 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:46.130718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d45104-6397-4740-ad90-b74822d88474", "name": "network-vif-plugged", "status": "completed", "tag": "2597c8d6-b463-450f-a8ab-cecf96eb5db0"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:46.139361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:46.139361 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:46.143105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:46.155594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] Creating event network-vif-plugged:2597c8d6-b463-450f-a8ab-cecf96eb5db0 for instance d6d45104-6397-4740-ad90-b74822d88474 on hv-cinder-85221 Sep 02 21:30:46.165643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c267afc6-6b91-4dd7-8173-68257423ae4b req-a85adf2f-9365-4e12-896a-c304281811c6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206996 Sep 02 21:30:46.166684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 350/750] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:46.965249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:46.966069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:46.972822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:46.973304 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:46.973818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:46.974506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:46.974972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:46.975388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:47.119552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:47.128647 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3786d0f4-a35d-4f68-b5ba-34466bb496e6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.167437 Sep 02 21:30:47.129509 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 401/751] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:46 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:48.154899 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:48.157422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:48.164745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.165441 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.166105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.167052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.167693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.168225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.330257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:48.338711 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c440a46f-451a-4933-afaa-94782a0dd75f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1366 microversion: 2.1 time: 0.189295 Sep 02 21:30:48.340957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 351/752] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:48 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:49.364799 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:49.365519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:49.372290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.372859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.373366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.374223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.374745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.375901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.519230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:49.527920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1c9ef48d-7261-4110-be5c-3409b4bf7ec7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1556 microversion: 2.1 time: 0.166637 Sep 02 21:30:49.528768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 402/753] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:49 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:49.551905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:49.560805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:49.560805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.560805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.560805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.561229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.561229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.561517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.642781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-75223746-8a14-469f-b78f-f5028bc683a3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094859 Sep 02 21:30:49.643401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 352/754] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:30:49 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:51.147847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d45104-6397-4740-ad90-b74822d88474", "tag": "2597c8d6-b463-450f-a8ab-cecf96eb5db0"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:51.163031 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.163773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.164428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.177927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] Creating event network-changed:2597c8d6-b463-450f-a8ab-cecf96eb5db0 for instance d6d45104-6397-4740-ad90-b74822d88474 on hv-cinder-85221 Sep 02 21:30:51.186107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a2a3f4c0-cf1c-4ed0-b0cd-e3807c786fb6 req-efad6c7c-041b-4f59-b802-ac38cc792f73 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042089 Sep 02 21:30:51.186900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 403/755] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:15.017782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=16 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.018558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.022710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:15.023213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:15.033698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.034224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.034668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.035395 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.035858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.036291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.072744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0ded0c6a-b6e2-401b-9a4b-fbab67f19a8d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments/38f5a3c0-30bd-4e8c-b1ff-f719cfb0c986" status: 200 len: 194 microversion: 2.20 time: 0.057188 Sep 02 21:31:15.073439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 353/756] 10.222.0.99 () {60 vars in 1454 bytes} [Fri Sep 2 21:31:15 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments/38f5a3c0-30bd-4e8c-b1ff-f719cfb0c986 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:31:15.152562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=13 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.154342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=65 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.159819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:15.161444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:15.168988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.169823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.170297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.171236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.172372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.172804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.272506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lazy-loading 'services' on Instance uuid 6083d5d9-fba6-4f90-a05f-5a37896e59a3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:31:15.625790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-83671310-440e-4972-b490-1156f8d81f06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments/38f5a3c0-30bd-4e8c-b1ff-f719cfb0c986" status: 202 len: 0 microversion: 2.20 time: 0.471305 Sep 02 21:31:15.625790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 404/757] 10.222.0.99 () {60 vars in 1457 bytes} [Fri Sep 2 21:31:15 2022] DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments/38f5a3c0-30bd-4e8c-b1ff-f719cfb0c986 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:31:15.636143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:15.638581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:15.659146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.664691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.664691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.664691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:15.664691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:15.665322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.711374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52ee886b-1276-4869-9f37-d36563dad95e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080210 Sep 02 21:31:15.712634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 354/758] 10.222.0.99 () {60 vars in 1343 bytes} [Fri Sep 2 21:31:15 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:31:16.725824 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:16.728181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:16.735089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:16.736148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:16.736590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:16.737296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:16.737780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:16.738211 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:16.769856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ce26136-42e8-48c1-8272-1712b03a2111 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048828 Sep 02 21:31:16.770422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 405/759] 10.222.0.99 () {60 vars in 1343 bytes} [Fri Sep 2 21:31:16 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:31:17.784867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:17.787329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:17.813098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:17.818279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:17.819063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:17.820033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:17.820608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:17.821109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:17.895744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fcc4adab-8cb6-4263-bd51-670596969294 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.116288 Sep 02 21:31:17.896731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 355/760] 10.222.0.99 () {60 vars in 1343 bytes} [Fri Sep 2 21:31:17 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:18.016700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:18.016700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:18.016700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.016700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.017482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:18.017482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.018039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.018765 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:18.051461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:31:18.385771 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ed5ba88f-c40c-4d78-8149-a89b82ca4fbb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 204 len: 0 microversion: 2.20 time: 0.391409 Sep 02 21:31:18.386380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 406/761] 10.222.0.99 () {60 vars in 1280 bytes} [Fri Sep 2 21:31:17 2022] DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:31:18.395663 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:18.398010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:18.402531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.403032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.403806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:18.404511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.404979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.405406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:18.545895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:18.555374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:18.556750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:18.558055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1029274c-0a82-4c3a-9ad9-a5379a0f0554 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.166245 Sep 02 21:31:18.558622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 356/762] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:18 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:31:19.585748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:19.586549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:19.593413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:19.595185 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:19.596013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:19.597241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:19.597949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:19.598579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:19.797422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.811429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.813325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.815388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3c4b0b55-f7b6-40b0-b21b-3c4fa5c04824 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.233685 Sep 02 21:31:19.815743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 407/763] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:19 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:20.844694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:20.845788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:20.855825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:20.856319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:20.860094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:20.860094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:20.860094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:20.860094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:21.311121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.334820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.338007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.339770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-45a8208c-ec44-43d2-a4fa-0bf8489044d6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.501628 Sep 02 21:31:21.341351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 357/764] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:20 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:22.369363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:22.370010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:22.383788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:22.384961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:22.385693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:22.386809 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:22.388756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:22.389842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:22.772428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:22.784993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:22.787558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:22.789260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-35f3d997-78fa-4d9b-95db-a9d22ee2fc52 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1722 microversion: 2.20 time: 0.425758 Sep 02 21:31:22.803003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 408/765] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:22 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:23.123949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083d5d9-fba6-4f90-a05f-5a37896e59a3", "name": "network-vif-deleted", "tag": "200d5ba3-9031-4fa2-8a8a-2d705bac3829"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:23.135195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:23.135862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:23.136251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.149385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] Creating event network-vif-deleted:200d5ba3-9031-4fa2-8a8a-2d705bac3829 for instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 on hv-cinder-85221 Sep 02 21:31:23.218949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-dc2706f8-a0f4-46c3-8be7-3dbc19cc7f5d req-88cf7f43-20b2-4c0d-bb79-38fe4cf2ada5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Sep 02 21:31:23.218949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 358/766] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:23.817295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:23.818638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:23.833127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:23.838013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:23.838585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.839369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:23.839853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:23.840296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.915372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:23.916110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:23.916761 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.917390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lazy-loading 'fault' on Instance uuid 6083d5d9-fba6-4f90-a05f-5a37896e59a3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:31:23.972627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.985298 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.986908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.988136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b6f864b0-e933-4f83-b236-2f9f2ca43385 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 200 len: 1371 microversion: 2.20 time: 0.175957 Sep 02 21:31:23.992720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 409/767] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:23 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:25.020857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:25.022359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:25.030680 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:25.032124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:25.032918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:25.033919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:25.034652 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:25.035181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:25.049766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 HTTP/1.1 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:31:25.051749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:31:25.053227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '6083d5d9-fba6-4f90-a05f-5a37896e59a3'} Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:25.054146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:31:25.055430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:31:25.056602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:25.056602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-408b5092-2198-4a3c-86d6-b2f57c72d224 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 404 len: 111 microversion: 2.20 time: 0.037359 Sep 02 21:31:25.056602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 359/768] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:25 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:31:25.063555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fa7515b2-9fa7-4d42-90de-e1cdcc5485f5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '.version_select at 0x7faac43ac4c0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:25.266633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fa7515b2-9fa7-4d42-90de-e1cdcc5485f5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908970511" status: 204 len: 0 microversion: 2.20 time: 0.205373 Sep 02 21:31:25.271513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 410/769] 10.222.0.99 () {60 vars in 1262 bytes} [Fri Sep 2 21:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908970511 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:31:26.518250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d8cdb762-1b4b-4dd5-8872-0754312c3b2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: .version_select at 0x7faac0e06ca0>, body: {"keypair": {"name": "tempest-keypair-974378514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI/zEKq1nxn7fpu6LqTyjZNY9pxfxiAWUaXKzXJpS3j8km26Tqorb9tt4+PqJguDwH9Xk0t7jpP+A3P3g/GnXkR3praBKLKfi+yl5IlCZvQ5NPquxb6KIlQqvl0BwbqMw=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:26.569885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-d8cdb762-1b4b-4dd5-8872-0754312c3b2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:26.576577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-d8cdb762-1b4b-4dd5-8872-0754312c3b2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for user e4f87633619b42d989942e1d63d30fb0 and project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:26.699909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d8cdb762-1b4b-4dd5-8872-0754312c3b2a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.186388 Sep 02 21:31:26.701363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 360/770] 10.222.0.99 () {62 vars in 1200 bytes} [Fri Sep 2 21:31:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 21:31:27.231138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0801b08a-a748-467c-8dae-2bafb12828c5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Action: 'create', calling method: .version_select at 0x7faac4351280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1904457527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDkmcBPrlwr0LpY46b5XKKRPrR/yu0qNwBte4vLFJAqpd7V+dKdUhk8+oCz+FH8i7O8BquYaFUfAoE2l+Eex21fkDWjgQM7neJlp41l5IVz21d4vjVNw8AU15TmXXZCKQ=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:27.249602 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-0801b08a-a748-467c-8dae-2bafb12828c5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for project beb5b0e674994eabb1e18fde391c2484. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:27.254239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-0801b08a-a748-467c-8dae-2bafb12828c5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for user e9450f3f7527406ab70fcf0b64cab787 and project beb5b0e674994eabb1e18fde391c2484. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:27.412442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0801b08a-a748-467c-8dae-2bafb12828c5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.361700 Sep 02 21:31:27.413120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 411/771] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:31:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:30.205336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1856845341", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8efadeb-2308-4c90-8862-ebd9e46f7697"}], "security_groups": [{"name": "tempest-securitygroup--2014339912"}], "key_name": "tempest-keypair-974378514", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:30.327122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] validate_networks() for [('b8efadeb-2308-4c90-8862-ebd9e46f7697', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:31:30.934779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:31:30.935210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:31:30.935964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:31:30.936384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:31:30.936805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:31:30.954554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:30.955149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:30.955866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:30.957026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:30.957879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:30.958349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:30.980613 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:30.986512 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Getting quotas for user e4f87633619b42d989942e1d63d30fb0 and project 94e62daccf4b442c8ff2971abbedd74f. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:31.000994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:31:31.004975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:31:31.192600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d1f8853-9656-4dc7-8275-9db8277cabe4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.992223 Sep 02 21:31:31.193735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 361/772] 10.222.0.99 () {62 vars in 1188 bytes} [Fri Sep 2 21:31:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 21:31:31.214212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:31.215362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:31.279062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.288333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.289909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.291007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-67f1cdf1-f74f-45ff-a6e1-57823b19d26f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1281 microversion: 2.20 time: 0.081450 Sep 02 21:31:31.291583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 412/773] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:31 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:32.317667 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:32.318363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:32.326957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:32.327443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:32.336924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:32.336924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:32.336924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:32.336924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:32.395221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:32.404068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:32.405509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:32.407517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bac35e50-4745-4285-b1d3-f4c07b40eaab tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1285 microversion: 2.20 time: 0.094356 Sep 02 21:31:32.407890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 362/774] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:32 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:33.434781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:33.435784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:33.444940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:33.445759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:33.446658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:33.447095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:33.447549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:33.448080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:33.514828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:33.525830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:33.527638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:33.529567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9cd78ec8-facb-40e9-988d-f10aac740c1d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1333 microversion: 2.20 time: 0.099979 Sep 02 21:31:33.531586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 413/775] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:33 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:34.558734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:34.559469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:34.566651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:34.567150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:34.567568 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:34.568368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:34.568826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:34.569257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:34.638878 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:34.647297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:34.648756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:34.649910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6bd854ee-38f1-4061-895e-be9a378b0e40 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1351 microversion: 2.20 time: 0.095330 Sep 02 21:31:34.659677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 363/776] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:34 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:35.676743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:35.677499 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:35.684532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:35.685098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:35.685538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:35.686259 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:35.686713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:35.687137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:35.865242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:35.888077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:35.891850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:35.894931 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6eb4e104-c085-42ec-9d7a-ed0e551b9404 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.221945 Sep 02 21:31:35.895228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 414/777] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:35 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:36.175930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:36.193641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:36.194477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:36.195184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:36.216526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] Creating event network-changed:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:31:36.223982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c4977a88-d701-458e-a06d-405b5cda8bbc req-cfb33aeb-3e9e-4a25-803a-967dc2e63a92 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054097 Sep 02 21:31:36.224986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 364/778] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:36.920649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:36.921240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:36.929013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:36.929891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:36.930350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:36.931088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:36.931553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:36.931987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:37.143887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:37.152598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:37.154411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:37.155546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fa73fe4e-34a1-482e-9298-9f5845774665 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.238998 Sep 02 21:31:37.156999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 415/779] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:36 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:38.183682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:38.184399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:38.191027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:38.191514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:38.191966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:38.192687 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:38.193174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:38.193559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:38.366576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:38.376211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:38.377867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:38.379033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c61db07d-269d-4fca-b675-94bab3edc210 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.200300 Sep 02 21:31:38.381761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 365/780] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:38 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:39.409235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:39.409893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:39.416447 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:39.416930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:39.417405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:39.418138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:39.418595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:39.419023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:39.561636 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:39.570901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:39.572327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:39.573437 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-86210693-4ab1-49b7-b6ab-8a35d84e66b5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.168317 Sep 02 21:31:39.575990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 416/781] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:39 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:40.600750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:40.601367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:40.612376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:40.612879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:40.613320 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:40.614067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:40.614533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:40.614961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:40.755729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:40.763982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:40.765953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:40.767363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e6ed38a3-21c8-4405-8a91-a9d0c244fde5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.170618 Sep 02 21:31:40.767922 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 366/782] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:40 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:41.794011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:41.794610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:41.798997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:41.802544 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:41.803038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:41.803533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:41.804244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:41.804705 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:41.805133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:41.944606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:41.952967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:41.954643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:41.955699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e17adf22-0f1a-4615-a4de-19812e39e046 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.165636 Sep 02 21:31:41.956269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 417/783] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:41 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:42.999969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:43.001199 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:43.003949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:43.010035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=10 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:43.019057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:43.019572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:43.020147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:43.021781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:43.022282 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:43.022869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:43.170355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:43.179721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:43.181181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:43.182349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9e300905-7805-444c-aaa6-6d2c7332042f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.202266 Sep 02 21:31:43.182932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 367/784] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:42 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:44.207781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:44.208486 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:44.214835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:44.215312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:44.215742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:44.216430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:44.216875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:44.217409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:44.353930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:44.363945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:44.373822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:44.373822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-caec4c67-1ab8-4113-9e24-b1adb74b3b53 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.163118 Sep 02 21:31:44.373822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 418/785] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:44 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:44.631677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "name": "network-vif-plugged", "status": "completed", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:44.641393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:44.641957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:44.642411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:44.653401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] Creating event network-vif-plugged:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:31:44.659671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-50f5c742-e9cb-4585-b1f8-fb2f578ec683 req-dfac7358-39cf-4976-a54e-6ef1ada2b68a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 Sep 02 21:31:44.660371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 368/786] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:45.392537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:45.393099 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:45.395676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:45.400787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.401286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.401750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.402474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.402928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.403359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.406463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:45.559079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:45.569273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:45.570822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:45.571948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ec2bfc57-08e5-4ccd-abe7-b4c96f6f03e5 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.184383 Sep 02 21:31:45.572518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 419/787] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:45 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:46.602535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:46.603248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:46.605225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:46.610218 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:46.611260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:46.611260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:46.611901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:46.612360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:46.612792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:46.750206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:46.759109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:46.760567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:46.761690 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-869bec5b-cd4b-4b07-b98b-8ba246347f79 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1407 microversion: 2.20 time: 0.164069 Sep 02 21:31:46.762311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 369/788] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:46 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:47.787611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:47.788255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:47.796108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:47.796533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:47.796977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:47.797675 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:47.798160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:47.799197 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:47.939396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:47.947928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:47.950098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:47.951287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7b530c61-3c17-4f30-9baa-5f9033b09865 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1599 microversion: 2.20 time: 0.168406 Sep 02 21:31:47.951849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 420/789] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:47 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:47.977099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:47.977612 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:47.984254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:47.984741 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:47.985178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:47.986253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:47.986522 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:47.987228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:47.991268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=77 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:48.074169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-41c79756-81c3-498e-af5e-3b93fb73db9e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100977 Sep 02 21:31:48.074768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 370/790] 10.222.0.99 () {60 vars in 1316 bytes} [Fri Sep 2 21:31:47 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:31:49.139387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:49.149637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:49.150153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:49.150591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:49.163133 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] Creating event network-changed:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:31:49.168671 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-17fa7ed7-5bd6-461e-a8bb-3e49d5fa1808 req-59c349b0-49ac-4d3a-9aa8-0fa05140a1b8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Sep 02 21:31:49.169528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 421/791] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:53.200099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:53.200750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:53.208328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:53.208826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:53.209280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:53.210015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:53.210480 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:53.210910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:53.307654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'services' on Instance uuid 5b88b58d-da51-49e3-8cd2-622325c153a7 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:31:53.541496 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-89802aa7-027f-4f5f-bba6-a6d01b9a785b tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments/7c32ad7e-7528-48de-86f9-3a21d42cba25" status: 202 len: 0 microversion: 2.1 time: 0.345882 Sep 02 21:31:53.542129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 371/792] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:31:53 2022] DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments/7c32ad7e-7528-48de-86f9-3a21d42cba25 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:31:53.552387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:53.558038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:53.562569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:53.563062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:53.563510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:53.565262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:53.565853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:53.566294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:53.599891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b92df6d-34fe-4f83-b00e-d1a7c058d549 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052855 Sep 02 21:31:53.600489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 422/793] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:31:53 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:54.616226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:54.618695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:54.625108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:54.625601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:54.626069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:54.627442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:54.627928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:54.628624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:54.660032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e335101f-b258-430e-b37f-e4ce1259d902 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048685 Sep 02 21:31:54.660605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 372/794] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:31:54 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:55.672900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:55.675658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:55.685700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:55.685700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:55.685700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:55.685700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:55.686300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:55.686300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:55.717285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dbbcc976-bb20-41e5-b1c5-7d9117fd5464 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048471 Sep 02 21:31:55.717895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 423/795] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:31:55 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:31:55.810903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:55.811640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:55.822229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:55.822927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:55.823455 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:55.824169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:55.824631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:55.825067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:55.853023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:31:56.197590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a5c1b93f-60d4-40c4-8ebd-fcc9a007939a tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 204 len: 0 microversion: 2.1 time: 0.392798 Sep 02 21:31:56.198214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 373/796] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:31:55 2022] DELETE /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:31:56.209042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:56.209762 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:56.215871 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:56.216358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:56.216801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:56.217502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:56.218001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:56.218429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:56.364362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:56.372289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a86a8ed2-c9dd-4b7b-972a-ecbca2b21c04 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1691 microversion: 2.1 time: 0.169241 Sep 02 21:31:56.372865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 424/797] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:56 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:57.398500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:57.399217 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:57.406225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:57.406717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:57.407158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:57.407994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:57.408978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:57.409422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:57.557414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:57.566767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-144b30fe-8d84-46a9-b69e-9aec12be3558 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1691 microversion: 2.1 time: 0.172574 Sep 02 21:31:57.567348 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 374/798] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:57 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:57.724400 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1694348425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1904457527", "security_groups": [{"name": "tempest-secgroup-smoke-459655726"}], "block_device_mapping_v2": [{"uuid": "966c1f09-3397-45be-b011-78d886172931", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7eb9ec5-d03f-40fe-896f-85a06c8dd029"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:57.845176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] validate_networks() for [('f7eb9ec5-d03f-40fe-896f-85a06c8dd029', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:31:58.517888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:31:58.518419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:31:58.519078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:31:58.519614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:31:58.520094 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:31:58.529873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:58.530381 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:58.530811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:58.531544 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:58.531997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:58.532431 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:58.551738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:58.556390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for user e9450f3f7527406ab70fcf0b64cab787 and project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:58.591302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:58.591926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:58.599813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:58.600316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:58.600769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:58.601492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:58.601988 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:58.602424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:58.621326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:31:58.623788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='966c1f09-3397-45be-b011-78d886172931',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:31:58.749047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:58.757290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9ee3f1d-0944-4c9b-a766-dfa530746975 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1691 microversion: 2.1 time: 0.169981 Sep 02 21:31:58.757909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 375/799] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:58 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:59.246192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f4ff760a-e0a1-47bd-9141-509136f2d1dc tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.528528 Sep 02 21:31:59.249881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 425/800] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:31:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:31:59.258905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-95a3708b-354d-4f0b-a933-d13769691cfa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:59.259545 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-95a3708b-354d-4f0b-a933-d13769691cfa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:59.325906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-95a3708b-354d-4f0b-a933-d13769691cfa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:59.333580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-95a3708b-354d-4f0b-a933-d13769691cfa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1095 microversion: 2.1 time: 0.078651 Sep 02 21:31:59.334220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 376/801] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:59 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:59.459240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:59.461543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:59.468081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.468601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.469051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.469806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.470295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.470915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.511514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9a0ae890-853b-4ee5-8cc0-c0453f6dbcc8 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056551 Sep 02 21:31:59.516043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 426/802] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:31:59 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:31:59.580507 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:59.581117 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:59.587452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.587986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.588437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.589204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.589668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.590129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.620595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:31:59.781060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:59.781603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:59.788915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.789407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.789873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.790579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:59.791075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:59.791504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:59.949186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:59.963803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e15a2843-8a45-4c7f-be49-84c7be2d07a7 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1691 microversion: 2.1 time: 0.186527 Sep 02 21:31:59.964868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 427/803] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:59 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:00.351939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-62a66435-26ca-4fb5-88f2-c8daac79b9c4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 204 len: 0 microversion: 2.1 time: 0.775057 Sep 02 21:32:00.352781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 377/804] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:31:59 2022] DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:32:00.358465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dd4bd84a-aeb6-432e-8940-9f561bfd7079 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:00.359406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dd4bd84a-aeb6-432e-8940-9f561bfd7079 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:00.361666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:00.362501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:00.368763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:00.369258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:00.369697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:00.370442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:00.370907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:00.371338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:00.453970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dd4bd84a-aeb6-432e-8940-9f561bfd7079 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:00.462278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dd4bd84a-aeb6-432e-8940-9f561bfd7079 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1095 microversion: 2.1 time: 0.108743 Sep 02 21:32:00.466104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 428/805] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:00 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1095 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:00.546225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:00.554469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5029a4cb-7e26-4640-9d09-b751fce22d9a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1673 microversion: 2.1 time: 0.197232 Sep 02 21:32:00.555062 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 378/806] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:00 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:01.006053 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:01.006654 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:01.014008 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.014500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.014938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.015648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.016098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.016523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.160153 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:01.168196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9ec962e4-7722-4154-aef4-22a7308540eb tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1691 microversion: 2.1 time: 0.167370 Sep 02 21:32:01.168783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 429/807] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:00 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:01.486465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:01.487081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:01.494134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.494624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.495063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.495816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.496269 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.496697 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.579048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:01.580656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:01.585042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:01.587706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.588398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.589031 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.589916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:01.590493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:01.591437 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:01.597813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8a87e029-21bc-4c5b-9fb1-efaa94a07805 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1145 microversion: 2.1 time: 0.115118 Sep 02 21:32:01.603445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 379/808] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:01 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:01.855585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:01.866929 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ceb8bbd3-c0f2-438c-8460-38c4ac08a20d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1673 microversion: 2.1 time: 0.292002 Sep 02 21:32:01.867825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 430/809] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:01 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1673 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:02.201463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:02.202551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:02.210527 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.211271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.212046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.213279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.214149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.214929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.342521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:02.353764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3c6b53c8-76b7-49ec-b510-871ee92d021d tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1623 microversion: 2.1 time: 0.163050 Sep 02 21:32:02.354773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 380/810] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:02 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1623 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:02.624209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:02.625052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:02.633263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.633797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.634247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.635044 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.635540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.635977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.732167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:02.750179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-262a0bd9-a992-44cb-b1f2-5c10f515b048 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1193 microversion: 2.1 time: 0.129961 Sep 02 21:32:02.784407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 431/811] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:02 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1193 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:02.788402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b88b58d-da51-49e3-8cd2-622325c153a7", "name": "network-vif-deleted", "tag": "49ed4384-e2c4-4c60-b914-6c903bda4aab"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:02.800022 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.800529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.800961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.819316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] Creating event network-vif-deleted:49ed4384-e2c4-4c60-b914-6c903bda4aab for instance 5b88b58d-da51-49e3-8cd2-622325c153a7 on hv-cinder-85221 Sep 02 21:32:02.824607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-b84bf299-a077-4400-8097-424c85d6a46e req-66ae5c71-8705-449b-89f8-fe49c0963b09 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Sep 02 21:32:02.825939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 381/812] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:02.894106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:02.898092 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:02.908152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.908667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.909189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:02.909985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:02.910461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:02.910906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.150710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:03.162501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a1fd540-4ed8-4631-a0ee-f0347a535c4c tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1673 microversion: 2.1 time: 0.273541 Sep 02 21:32:03.163137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 432/813] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:02 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:03.386675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:03.388597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:03.403893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.405189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.406376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.407582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.408363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.409145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.493377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.495606 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.497043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.503683 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'fault' on Instance uuid 5b88b58d-da51-49e3-8cd2-622325c153a7 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:03.623903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:03.639525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b7a9c16f-1ce4-418e-89fc-3a00b4538e2c tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1335 microversion: 2.1 time: 0.263370 Sep 02 21:32:03.641675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 382/814] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:03 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1335 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:03.798271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:03.804974 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:03.815844 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.818152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.818849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.822486 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.823854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.841072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2f4ef0-ee14-44b1-aced-1da687734ffa", "name": "network-vif-deleted", "tag": "6fb427ad-794c-4ae8-8f2e-cc4bea6ef643"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:03.842110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.871900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:03.872388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:03.872817 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:03.905220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] Creating event network-vif-deleted:6fb427ad-794c-4ae8-8f2e-cc4bea6ef643 for instance ff2f4ef0-ee14-44b1-aced-1da687734ffa on hv-cinder-85221 Sep 02 21:32:03.926843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-013fc1b4-4299-4e2e-afd6-450401e45330 req-4e6e5c33-196f-43f0-91c8-005b41a02f13 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088308 Sep 02 21:32:03.929803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 383/815] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:04.013450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:04.038784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-edb13361-b1c0-4aea-8450-0693ee1ccdb0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1211 microversion: 2.1 time: 0.250690 Sep 02 21:32:04.040052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 433/816] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:03 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1211 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:04.188490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:04.189502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:04.197363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.198059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.198585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.199497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.200048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.200564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.324401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:04.333926 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-46cb9252-64be-443c-b13c-3f36468ad724 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1322 microversion: 2.1 time: 0.150274 Sep 02 21:32:04.350285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 384/817] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:04 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:04.686834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:04.687713 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:04.695167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.695964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.696692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.697669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.698414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.699088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.741915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.742557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.743147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.743669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'fault' on Instance uuid 5b88b58d-da51-49e3-8cd2-622325c153a7 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:04.813659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:04.827000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-03987516-f027-4d52-a869-455a82682aaa tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 200 len: 1335 microversion: 2.1 time: 0.146065 Sep 02 21:32:04.828155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 434/818] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:04 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 1335 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:05.065595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:05.066300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:05.073563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.074145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.074594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.075333 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.075801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.076232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.079489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:05.328458 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:05.337443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d35823b7-ccf8-4aa1-b539-7168b6cbe928 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1278 microversion: 2.1 time: 0.278419 Sep 02 21:32:05.338239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 385/819] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:05 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:05.358907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:05.359804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:05.370090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.370090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.370090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.370090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.370568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.370568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.411147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.411961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.412600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.413240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lazy-loading 'fault' on Instance uuid ff2f4ef0-ee14-44b1-aced-1da687734ffa {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:05.490457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:05.499147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aa81ca1c-0db0-45d0-b60a-2a698b96da04 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 200 len: 1327 microversion: 2.1 time: 0.144287 Sep 02 21:32:05.499985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 435/820] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:05 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:05.855498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:05.856207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 5b88b58d-da51-49e3-8cd2-622325c153a7] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:05.862791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.863267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.863743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.864498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.864937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.865360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.879079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] HTTP exception thrown: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Request method failure captured: Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 HTTP/1.1 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRpvEcdPnGtprDf5fO7SZYQkmKMkufJPNA5HvOGKgMUGPHY_jUNscYa1CTrrjnk8XAtzr43uE_WGTXyRKE_lXJCTVxN-dZh9Hp5Qx0sjHvJ2VvBZV2BJ3bZXlysQ71apox1y6RMxV1WB48xGDtQUSMcysCJcSbnx6YAaXzvrKwEdM Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 786534cce098405196143139d375b465 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:05.880716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/786534cce098405196143139d375b465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_786534cce098405196143139d375b465", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 786534cce098405196143139d375b465 Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: dc0bc75b6b3f4d1689bc1f7faaa2e5bc Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. Sep 02 21:32:05.887932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '5b88b58d-da51-49e3-8cd2-622325c153a7'} Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:05.889164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. Sep 02 21:32:05.890933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:05.892860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Returning 404 to user: Instance 5b88b58d-da51-49e3-8cd2-622325c153a7 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:05.892860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-425c0897-3452-41d5-82d6-ddabaf59b876 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7" status: 404 len: 111 microversion: 2.1 time: 0.030842 Sep 02 21:32:05.892860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 386/821] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:05 2022] GET /compute/v2.1/servers/5b88b58d-da51-49e3-8cd2-622325c153a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:32:05.893909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-171c27dc-de47-46ed-afe3-644ace53bd23 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '.version_select at 0x7faac4260280>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:06.024052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-171c27dc-de47-46ed-afe3-644ace53bd23 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609335787" status: 202 len: 0 microversion: 2.1 time: 0.134824 Sep 02 21:32:06.025063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 436/822] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609335787 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:06.257780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6b5d14-aed2-4682-981c-77f4c379c55a", "tag": "eca48be6-00d0-402a-bd61-5bf499264906"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:06.271160 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.271706 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.272147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.292755 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] Creating event network-changed:eca48be6-00d0-402a-bd61-5bf499264906 for instance 5c6b5d14-aed2-4682-981c-77f4c379c55a on hv-cinder-85221 Sep 02 21:32:06.302183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-86a59020-0900-4515-a3af-062c42429d10 req-418ed13a-0daa-424e-bb8a-7b6a07f70e13 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051745 Sep 02 21:32:06.303046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 387/823] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:06.360969 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:06.361585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:06.368225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.368722 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.369162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.370156 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.370789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.371227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.526698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:06.527659 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:06.544146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.544146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.544146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.544146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.544644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.544644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.569282 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa HTTP/1.1 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:06.572905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:32:06.577326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ff2f4ef0-ee14-44b1-aced-1da687734ffa'} Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:06.582749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:32:06.584241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:06.585355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:06.585355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-79e328cd-f65b-4d4f-9fbc-2f455357c43d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 404 len: 111 microversion: 2.1 time: 0.053621 Sep 02 21:32:06.585355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 388/824] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:06 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:06.588825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-74247933-7afe-49f5-b042-c8a4c3f386bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '.version_select at 0x7faac0a9c0d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:06.690756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:06.699359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d209d490-32b5-4710-8a7d-4c23d7cb62d9 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.342482 Sep 02 21:32:06.699962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 437/825] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:06 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:06.715530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-74247933-7afe-49f5-b042-c8a4c3f386bf tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416911051" status: 202 len: 0 microversion: 2.1 time: 0.131375 Sep 02 21:32:06.716410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 389/826] 10.222.0.99 () {58 vars in 1221 bytes} [Fri Sep 2 21:32:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416911051 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:07.724693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:07.725440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:07.733269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:07.733785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:07.734293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:07.734936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:07.735395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:07.736385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:07.754733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:07.783435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5411f725-ad26-4415-b593-89122d17ae4d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: .version_select at 0x7faac0a24160>, body: {"keypair": {"name": "tempest-keypair-516523201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSwQMtjM2S9YeI86a/aLW5gj/uOD+XWxl6a52MebE/Ttx/PXhlfwyLv0b4dO2xbpmftRdfzNtUBK1YAfZaAUYzY5n7IQNRp/EQOuJe0ufCHJ6lfas+CFQbxWYQHLN3mJg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:07.803923 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5411f725-ad26-4415-b593-89122d17ae4d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for project d1e4957407e948fc909aadade7d19719. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:07.808418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5411f725-ad26-4415-b593-89122d17ae4d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for user 2ca47c37cd2d4999afa598cac6daa2e7 and project d1e4957407e948fc909aadade7d19719. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:07.882611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:07.891226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bb6fa059-41e7-47e0-b872-161f0e1f9769 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.170478 Sep 02 21:32:07.891887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 438/827] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:07 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:07.925186 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5411f725-ad26-4415-b593-89122d17ae4d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146544 Sep 02 21:32:07.927079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 390/828] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:32:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:08.914731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:08.915407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:08.917267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:08.922797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.923289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.923763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:08.924454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.924909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.925342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:09.093174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:09.101314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f5b5e1af-b8a1-4f17-9deb-3fe65d8ba72f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.190803 Sep 02 21:32:09.101924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 439/829] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:08 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:09.738523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:09.739096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:09.745522 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:09.746052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:09.746496 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:09.747193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:09.747646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:09.748068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:09.775560 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:10.129245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:10.130274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:10.137333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.137865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.138342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.139073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.139540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.139978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.163049 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cd8cbaff-e558-4998-933a-8a1fda3062de tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 204 len: 0 microversion: 2.1 time: 0.428850 Sep 02 21:32:10.163655 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 391/830] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:32:09 2022] DELETE /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:32:10.173907 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:10.174679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:10.181454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.182090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.182617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.183417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.183959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.184539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.459574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=8 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:10.748605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:10.762199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-25c891e1-cdf0-4da7-810b-0960ea9757e3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.639822 Sep 02 21:32:10.763003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 440/831] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:10 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:10.764876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:10.775201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b9ebb848-5b0c-4d4f-94ea-07561848d110 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1508 microversion: 2.1 time: 0.606381 Sep 02 21:32:10.775791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 392/832] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:10 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:11.357147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1315912972", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbb739d3-1cc5-4982-9fe9-8871ccbc1cc6"}], "security_groups": [{"name": "tempest-securitygroup--31632345"}], "key_name": "tempest-keypair-516523201", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:11.531833 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] validate_networks() for [('bbb739d3-1cc5-4982-9fe9-8871ccbc1cc6', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:32:11.786980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:11.787982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:11.795450 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:11.795950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:11.796398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:11.797110 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:11.797641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:11.798071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.056438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:12.064785 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-834bc171-97d4-49c1-9012-936885373c1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.281855 Sep 02 21:32:12.065105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 393/833] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:11 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:12.085115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:12.085754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:12.091734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.092213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.092660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.093373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.093875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.094314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.207052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:12.217077 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d1781926-497f-4907-9959-1db0350bea16 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1466 microversion: 2.1 time: 0.135691 Sep 02 21:32:12.217672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 394/834] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:12 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:12.254300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa471e49-7a31-4503-bb55-d08d1eaccc88", "name": "network-vif-deleted", "tag": "da88f783-6182-4201-aeab-8bef35459820"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:12.264137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.264631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.265070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.277620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] Creating event network-vif-deleted:da88f783-6182-4201-aeab-8bef35459820 for instance aa471e49-7a31-4503-bb55-d08d1eaccc88 on hv-cinder-85221 Sep 02 21:32:12.280499 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:32:12.281628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:32:12.282234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:32:12.283266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-f739603f-9a3e-4b5c-8f6d-96610bbdac35 req-d2ff52df-23c3-4b5b-a4f1-436e89ef7a0b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034056 Sep 02 21:32:12.283446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:32:12.284036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:32:12.284356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 395/835] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:12.295526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.295526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.295526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.295526 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.295986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.296408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.315489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for project d1e4957407e948fc909aadade7d19719. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:12.320066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Getting quotas for user 2ca47c37cd2d4999afa598cac6daa2e7 and project d1e4957407e948fc909aadade7d19719. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:12.332922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:32:12.335207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:32:12.446140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b44f87f1-8b36-4c65-af0c-791a614cfbf6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.098511 Sep 02 21:32:12.447233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 441/836] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:32:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:32:12.461067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-77a3b97a-72bb-4323-8c81-2ed6ed82fe94 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:12.462170 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-77a3b97a-72bb-4323-8c81-2ed6ed82fe94 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:12.526377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-77a3b97a-72bb-4323-8c81-2ed6ed82fe94 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:12.537142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-77a3b97a-72bb-4323-8c81-2ed6ed82fe94 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1237 microversion: 2.1 time: 0.080903 Sep 02 21:32:12.538031 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 396/837] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:12 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:13.088350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.088969 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:13.097301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.097817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.099623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.099623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.099623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.100013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.242028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.242783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:13.249852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:13.250138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.250629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.251072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.252693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.253206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.253613 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.258581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aedef906-4c1b-4fab-9871-75cab97b34ae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.174077 Sep 02 21:32:13.262515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 442/838] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:13 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:13.287825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.288233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.288676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.289125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'fault' on Instance uuid aa471e49-7a31-4503-bb55-d08d1eaccc88 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:13.330374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:13.338238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d002e1fb-fe71-4ebf-8147-b9fd60a82827 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1312 microversion: 2.1 time: 0.100369 Sep 02 21:32:13.338806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 397/839] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:13 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:13.560497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.561142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:13.568144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.568729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.569063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.569807 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.570264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.570690 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.637821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:13.647126 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-68a11e77-b877-4025-a789-25d9d9fca374 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1241 microversion: 2.1 time: 0.090634 Sep 02 21:32:13.647720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 443/840] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:13 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:14.282867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:14.283493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:14.290432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.290949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.291399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.292101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.292590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.293021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.363319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:14.363935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:14.369917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.370428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.370881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.371584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.372515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.372515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.405378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.405916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.406359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.406812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'fault' on Instance uuid aa471e49-7a31-4503-bb55-d08d1eaccc88 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:14.463184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:14.471239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8467c0c5-16bd-4524-a60a-aaac97bd98e8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 200 len: 1312 microversion: 2.1 time: 0.112293 Sep 02 21:32:14.471834 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 444/841] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:14 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:14.478226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:14.487380 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0280d1fd-b763-42ef-b13b-39071ed38f49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.208569 Sep 02 21:32:14.488268 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 398/842] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:14 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:14.671444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:14.672061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:14.679701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.680190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.680632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.681334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.681853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.682252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.745967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:14.754049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c1309710-bb3c-4b2f-8b13-4fc209ac448a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1241 microversion: 2.1 time: 0.086679 Sep 02 21:32:14.754616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 445/843] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:14 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:15.497969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:15.498999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: aa471e49-7a31-4503-bb55-d08d1eaccc88] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:15.509952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.510788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.511592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.512805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.513528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.514297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.515569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:15.516474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:15.524273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.524725 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.525242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.526111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.526587 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.527083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.535141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] HTTP exception thrown: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Request method failure captured: Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 HTTP/1.1 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRpvEcdPnGtprDf5fO7SZYQkmKMkufJPNA5HvOGKgMUGPHY_jUNscYa1CTrrjnk8XAtzr43uE_WGTXyRKE_lXJCTVxN-dZh9Hp5Qx0sjHvJ2VvBZV2BJ3bZXlysQ71apox1y6RMxV1WB48xGDtQUSMcysCJcSbnx6YAaXzvrKwEdM Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 786534cce098405196143139d375b465 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:15.536975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/786534cce098405196143139d375b465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_786534cce098405196143139d375b465", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 786534cce098405196143139d375b465 Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: dc0bc75b6b3f4d1689bc1f7faaa2e5bc Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. Sep 02 21:32:15.538350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'aa471e49-7a31-4503-bb55-d08d1eaccc88'} Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:15.539076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. Sep 02 21:32:15.540700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:15.541870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Returning 404 to user: Instance aa471e49-7a31-4503-bb55-d08d1eaccc88 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:15.541870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-075d86ef-2d7e-4613-bc6b-f4d85d8dcfcd tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88" status: 404 len: 111 microversion: 2.1 time: 0.047474 Sep 02 21:32:15.541870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 399/844] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:15 2022] GET /compute/v2.1/servers/aa471e49-7a31-4503-bb55-d08d1eaccc88 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:15.554906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:15.555601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:15.557369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:15.562906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.563415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.564241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.564824 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.565291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.566362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.598463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:15.683438 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:15.692401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f118e563-1e5a-42c0-8582-cb89b85b27f1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.182458 Sep 02 21:32:15.692987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 446/845] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:15 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:15.777274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:15.778275 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:15.785486 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.791816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.791816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.791816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.791816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.792282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.853285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:15.861279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b9cc7c94-2efa-4468-b758-fe42a13a85ce tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1289 microversion: 2.1 time: 0.088545 Sep 02 21:32:15.861891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 447/846] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:15 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:15.975174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-493c2e0a-73df-4648-a5f9-66c862232e25 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 204 len: 0 microversion: 2.1 time: 0.424474 Sep 02 21:32:15.975767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 400/847] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:32:15 2022] DELETE /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:32:15.983749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:15.984360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:15.986360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:15.992440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.992924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.993370 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.994102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:15.994565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:15.994994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.133368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:16.141427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cbf488ed-7522-477b-acdd-18f4fa8f8bc8 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.161577 Sep 02 21:32:16.142033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 448/848] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:15 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:16.719894 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:16.720682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:16.728874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.729892 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.730024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.730925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.731461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.732145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.888355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:16.889485 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:16.898268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.899015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.900202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.901121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.901754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.902337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.931372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:16.943137 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4025d0b7-5ffe-4d9c-9aad-2da46f07aecd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.231355 Sep 02 21:32:16.944590 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 401/849] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:16 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:17.014652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:17.024558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9058920e-784a-457d-a957-b8f64f197f98 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1295 microversion: 2.1 time: 0.142614 Sep 02 21:32:17.025184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 449/850] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:16 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:17.164781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:17.165393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:17.171576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.172066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.172508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.173252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.173800 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.174258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.436796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:17.447792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4b73ac6b-bf72-4f6b-9ab3-eff7fb7b4506 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1523 microversion: 2.1 time: 0.286896 Sep 02 21:32:17.448952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 402/851] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:17 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:17.705282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf9bb41-be89-4802-ba81-6eb3fa5ebb68", "name": "network-vif-deleted", "tag": "97b914ee-5150-4e32-adc8-6632678fd9f8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:17.716020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.716743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.717246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.731113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] Creating event network-vif-deleted:97b914ee-5150-4e32-adc8-6632678fd9f8 for instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 on hv-cinder-85221 Sep 02 21:32:17.737336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-40e48889-5f71-4ae2-bbb7-b12ed4d916cf req-41a4abb5-64c1-46de-9140-47ba28c0b2c6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037655 Sep 02 21:32:17.739149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 450/852] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:17.971635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:17.972985 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:17.979864 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.981213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.981664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.982417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.982885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.983316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.050490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:18.051503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:18.058755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.059263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.059705 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.060489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.060960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.061429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.229068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:18.240306 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4f375b25-2ad8-4247-8370-e61b28acf270 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.272705 Sep 02 21:32:18.243973 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 403/853] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:17 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:18.384529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:18.394469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-afaf3bce-7b41-4134-aeb7-3d5cf4477b97 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.348494 Sep 02 21:32:18.395494 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 451/854] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:18 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:18.478754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:18.479570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:18.486674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.487285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.487722 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.488454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.488913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.489373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.505379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:18.522622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.523029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.523468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.523914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lazy-loading 'fault' on Instance uuid 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:18.564793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bc75b6b3f4d1689bc1f7faaa2e5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786534cce098405196143139d375b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:18.573225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b41011f5-e126-42d4-819e-0451275abbc4 tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 200 len: 1312 microversion: 2.1 time: 0.098449 Sep 02 21:32:18.573827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 404/855] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:18 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:18.652418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993dfc89-c315-4607-a0d2-1e2733afa8b5", "tag": "3ad91c75-b560-4706-b245-5afdbadb2696"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:18.663442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.663959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.664497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.677371 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] Creating event network-changed:3ad91c75-b560-4706-b245-5afdbadb2696 for instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 on hv-cinder-85221 Sep 02 21:32:18.682324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-ea8205df-cfe4-497b-903e-1c87a33da3bd req-eac57887-d450-4cac-9073-4b2fd57b045b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Sep 02 21:32:18.683182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 452/856] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:19.073908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6b5d14-aed2-4682-981c-77f4c379c55a", "name": "network-vif-plugged", "status": "completed", "tag": "eca48be6-00d0-402a-bd61-5bf499264906"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:19.084805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.085292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.085823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.100003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] Creating event network-vif-plugged:eca48be6-00d0-402a-bd61-5bf499264906 for instance 5c6b5d14-aed2-4682-981c-77f4c379c55a on hv-cinder-85221 Sep 02 21:32:19.105439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-a6c777b6-5a71-4f18-ad70-fcb7efa803aa req-37b3ff86-726c-4704-af8d-0283894685c2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035248 Sep 02 21:32:19.106155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 405/857] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:19.266615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:19.267512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:19.276723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.277217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.278127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.278863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.279789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.280559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.421443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:19.422187 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:19.430043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.430557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.430994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.431717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.432171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.432605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.502563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:19.512930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-32d8013b-fef6-4b12-9e78-009e63708345 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.250999 Sep 02 21:32:19.513828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 453/858] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:19 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:19.599360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:19.600155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] [instance: 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:19.610181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.610181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.610181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.610181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.618623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.618623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.626292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] HTTP exception thrown: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Request method failure captured: Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 HTTP/1.1 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSRpvEcdPnGtprDf5fO7SZYQkmKMkufJPNA5HvOGKgMUGPHY_jUNscYa1CTrrjnk8XAtzr43uE_WGTXyRKE_lXJCTVxN-dZh9Hp5Qx0sjHvJ2VvBZV2BJ3bZXlysQ71apox1y6RMxV1WB48xGDtQUSMcysCJcSbnx6YAaXzvrKwEdM Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 786534cce098405196143139d375b465 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:32:19.628000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/786534cce098405196143139d375b465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/786534cce098405196143139d375b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_786534cce098405196143139d375b465", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 786534cce098405196143139d375b465 Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-239273526 Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: dc0bc75b6b3f4d1689bc1f7faaa2e5bc Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-239273526-project Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. Sep 02 21:32:19.630348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '6bf9bb41-be89-4802-ba81-6eb3fa5ebb68'} Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:19.631557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. Sep 02 21:32:19.633454 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:32:19.635309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] Returning 404 to user: Instance 6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:19.635309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8550ed9b-6af6-457c-a175-e74a2c342baf tempest-ServerRescueNegativeTestJSON-239273526 tempest-ServerRescueNegativeTestJSON-239273526-project] 10.222.0.99 "GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68" status: 404 len: 111 microversion: 2.1 time: 0.036514 Sep 02 21:32:19.635309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 454/859] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:19 2022] GET /compute/v2.1/servers/6bf9bb41-be89-4802-ba81-6eb3fa5ebb68 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:32:19.931699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:19.939374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d551e00e-82e4-48cf-a6c2-f44e3ec3b089 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.522689 Sep 02 21:32:19.940052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 406/860] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:19 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:20.544081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:20.545367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:20.553369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:20.553898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:20.554336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:20.555080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:20.555537 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:20.555966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:20.708491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:20.716948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-edcb0650-a5a9-4c47-9326-4bd8740c5af0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.176818 Sep 02 21:32:20.717703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 455/861] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:20 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:20.964230 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:20.964857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:20.972500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:20.973567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:20.974095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:20.974812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:20.975278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:20.975714 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.114467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:21.125617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c5566dd7-820c-4577-8b8c-d6ca5f4d1cc5 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.165840 Sep 02 21:32:21.126410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 407/862] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:20 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:21.743182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:21.743802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:21.750737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.751219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.751922 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.752643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.753146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.754814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.945560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:21.954010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d72c6323-f343-4749-ae8b-1db6e9bc4032 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.214636 Sep 02 21:32:21.954598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 456/863] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:21 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:22.149061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:22.150738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:22.157604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.158223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.158739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:22.160305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.160927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.161447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:22.369241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:22.377069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fa75998b-aedf-4b3f-a80c-ba65348dac49 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.232287 Sep 02 21:32:22.377638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 408/864] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:22 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:22.977283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:22.977948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:22.979925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:22.980619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:22.986139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.986628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.987069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:22.987836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.988296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.988729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.007349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:23.178404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:23.185174 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6d73e4ab-ff61-4994-b22c-ba18c29c82d1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1266 microversion: 2.1 time: 0.211752 Sep 02 21:32:23.185774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 457/865] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:22 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:23.401443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:23.402325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:23.404424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:23.410092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.410903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.411967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.412929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.413399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.413866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.646983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:23.655489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-636d37d2-7bae-447c-8ff8-5b35df6bdd46 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.259100 Sep 02 21:32:23.656066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 409/866] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:23 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:24.209990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:24.210552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:24.216973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.217457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.217925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.218628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.219082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.219510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.382043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:24.390461 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-254a42be-790d-40c5-95ce-7d462c97eb90 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1453 microversion: 2.1 time: 0.185600 Sep 02 21:32:24.391140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 458/867] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:24 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:24.416239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:24.416861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:24.423608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.424285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.424572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.425347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.425875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.426316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.586440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:24.594518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c49661f-b09f-4349-bd89-1a09479c4208 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1453 microversion: 2.1 time: 0.182308 Sep 02 21:32:24.595104 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 410/868] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:24 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:24.679952 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:24.680569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:24.695672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.696162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.701489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.701489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.701489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.702191 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.903455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:24.912912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a49b703-7c1e-4a38-b3d1-54c47f70e878 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.236825 Sep 02 21:32:24.913687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 459/869] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:24 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:25.936615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:25.937201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:25.946912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:25.946912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:25.946912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:25.946912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:25.947301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:25.947489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.124095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:26.132466 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-713aec5f-8fcc-4ecb-bd8e-ff19ff98fcee tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.199858 Sep 02 21:32:26.133036 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 411/870] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:25 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:26.954180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993dfc89-c315-4607-a0d2-1e2733afa8b5", "name": "network-vif-plugged", "status": "completed", "tag": "3ad91c75-b560-4706-b245-5afdbadb2696"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:26.964987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.965573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.966041 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.977686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] Creating event network-vif-plugged:3ad91c75-b560-4706-b245-5afdbadb2696 for instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 on hv-cinder-85221 Sep 02 21:32:26.985350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d7ab86f3-3888-44c3-85c6-d26d1b429e17 req-7cd368d3-b600-442f-ac6f-325f44141a99 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Sep 02 21:32:26.985350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 460/871] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:27.155912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:27.171794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:27.171794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:27.171794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:27.171794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:27.172538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:27.172538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:27.172538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:27.198106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6b5d14-aed2-4682-981c-77f4c379c55a", "tag": "eca48be6-00d0-402a-bd61-5bf499264906"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:27.214196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:27.214689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:27.215135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:27.227279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] Creating event network-changed:eca48be6-00d0-402a-bd61-5bf499264906 for instance 5c6b5d14-aed2-4682-981c-77f4c379c55a on hv-cinder-85221 Sep 02 21:32:27.233343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-62730d9f-9883-4ceb-8708-631d7191cb9a req-d9bfeb98-a823-4e65-a6ad-2b1464fd2c51 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039560 Sep 02 21:32:27.234532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 461/872] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:27.393208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:27.404334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-798838e8-7c38-4a74-99c5-a394ee335c4b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.252879 Sep 02 21:32:27.416560 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 412/873] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:27 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:28.432090 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:28.432802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:28.439376 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.439854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.440288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.441323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.441811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.442250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.585057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:28.592932 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1632a838-cec3-4928-a284-72732e97cf9f tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1361 microversion: 2.1 time: 0.165794 Sep 02 21:32:28.598686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 462/874] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:28 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:29.327814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2ce68bde-a87d-4bad-aa42-e89763662804 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac0a4eca0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:29.377980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2ce68bde-a87d-4bad-aa42-e89763662804 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2ed2ab97-cae5-4dfe-a34e-e6c1250ba11d" status: 200 len: 351 microversion: 2.1 time: 0.053892 Sep 02 21:32:29.378572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 413/875] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:32:29 2022] GET /compute/v2.1/os-volumes/2ed2ab97-cae5-4dfe-a34e-e6c1250ba11d => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:29.616618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:29.617237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:29.623788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.624273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.624711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.625400 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.626006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.626300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.761440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:29.770284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ed55cef2-bb55-4565-a1b0-fb35d20dff52 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1548 microversion: 2.1 time: 0.157184 Sep 02 21:32:29.771065 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 463/876] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:29 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:29.800585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:29.801860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:29.808533 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.811185 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.811646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.812379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.812852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.813368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.898679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-48d49833-2dac-447f-945d-36c73babfbc6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102142 Sep 02 21:32:29.899279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 414/877] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:32:29 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:31.279281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993dfc89-c315-4607-a0d2-1e2733afa8b5", "tag": "3ad91c75-b560-4706-b245-5afdbadb2696"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:31.287801 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:31.288291 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:31.288763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:31.301184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] Creating event network-changed:3ad91c75-b560-4706-b245-5afdbadb2696 for instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 on hv-cinder-85221 Sep 02 21:32:31.307262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-1e10a077-98d3-4965-9c9d-b8194e932199 req-c23c8b13-6a15-4bef-809f-46d4fd38d64d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 Sep 02 21:32:31.310021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 464/878] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:32.176516 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-38bca545-d48b-46c9-9611-e582460db643 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac0a9c280>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:32.227944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-38bca545-d48b-46c9-9611-e582460db643 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/832083bc-7164-4128-9ea2-b1867433ead9" status: 200 len: 351 microversion: 2.1 time: 0.054734 Sep 02 21:32:32.227944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 415/879] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:32:32 2022] GET /compute/v2.1/os-volumes/832083bc-7164-4128-9ea2-b1867433ead9 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:33.496387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:33.496973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:33.503249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.503706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.504798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.505567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.505980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.506410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.531686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-21d58a4e-d8e1-4f0b-8ebd-e0a876004ae5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/ips" status: 200 len: 149 microversion: 2.1 time: 0.242246 Sep 02 21:32:33.532235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 465/880] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:32:33 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/ips => generated 149 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:33.545394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92baa626-20d1-4d34-adb5-39d590afcb9d"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:33.547863 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:33.555146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.555631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.556069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.556764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.557224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.557653 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.644043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: POST /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/os-volume_attachments HTTP/1.1 Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 74 Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:33.646514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {"volumeAttachment": {"volumeId": "92baa626-20d1-4d34-adb5-39d590afcb9d"}} Sep 02 21:32:33.648152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'server_id': 'd6d45104-6397-4740-ad90-b74822d88474', 'body': {'volumeAttachment': {'volumeId': '92baa626-20d1-4d34-adb5-39d590afcb9d'}}} Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:33.649194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:33.650676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 400 to user: Invalid volume: volume 92baa626-20d1-4d34-adb5-39d590afcb9d is already attached to instances: f7a53988-5e75-44d2-9cb2-6f5c31e2144d {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-71e29955-058a-4626-bcea-8808e7e6d987 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107202 Sep 02 21:32:33.652270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 416/881] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:32:33 2022] POST /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:32:33.658075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:33.658582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:33.665348 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.665869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.666316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.667014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.667471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.667893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.692954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:34.045380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f796ba6b-cb7b-4644-81b6-700a61a4d391 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 204 len: 0 microversion: 2.1 time: 0.391057 Sep 02 21:32:34.046014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 466/882] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:32:33 2022] DELETE /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:32:34.057825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:34.061328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:34.065231 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.065746 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.066727 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.068324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.068790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.069229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.207385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:34.215307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5bfc89f1-03ab-4233-82bf-be5814b99965 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1680 microversion: 2.1 time: 0.161411 Sep 02 21:32:34.215884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 417/883] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:34 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:34.978161 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9a41bc1d-fafc-415b-9f1c-bcc75a2d657d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac4284ca0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.027465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9a41bc1d-fafc-415b-9f1c-bcc75a2d657d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/b316a26e-7eb2-402c-a379-60d6fc6e1226" status: 200 len: 350 microversion: 2.1 time: 0.053575 Sep 02 21:32:35.028119 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 467/884] 10.222.0.99 () {58 vars in 1245 bytes} [Fri Sep 2 21:32:34 2022] GET /compute/v2.1/os-volumes/b316a26e-7eb2-402c-a379-60d6fc6e1226 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:35.042704 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1cf1c6db-7014-4b6c-9f1c-8b397d7fe824 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac09d7dc0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.125634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1cf1c6db-7014-4b6c-9f1c-8b397d7fe824 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086625 Sep 02 21:32:35.126671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 418/885] 10.222.0.99 () {58 vars in 1134 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:35.140926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6c8de4bc-02e8-4025-b877-0aa6d160568d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac41cf4c0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.228904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6c8de4bc-02e8-4025-b877-0aa6d160568d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091676 Sep 02 21:32:35.229487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 468/886] 10.222.0.99 () {58 vars in 1149 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:35.239972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.240718 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:35.243948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd60dc7b-ae9e-4b80-b1d7-98ef2410f76d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac41cf550>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.247925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.248445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.248884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:35.249589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.250069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.250500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:35.333831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd60dc7b-ae9e-4b80-b1d7-98ef2410f76d tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093509 Sep 02 21:32:35.334394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 469/887] 10.222.0.99 () {58 vars in 1134 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:35.349352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-63328fd2-cfb1-4958-ad64-bae53beed9fe tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac4284dc0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.437267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-63328fd2-cfb1-4958-ad64-bae53beed9fe tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093451 Sep 02 21:32:35.438487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 470/888] 10.222.0.99 () {58 vars in 1167 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:35.452476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c7c258b6-4502-4aec-99be-b5b86b626032 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac424fca0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.541067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c7c258b6-4502-4aec-99be-b5b86b626032 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092874 Sep 02 21:32:35.541656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 471/889] 10.222.0.99 () {58 vars in 1170 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:35.556113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-898f79cd-f213-4fc3-adea-8b56cf303107 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac43ac9d0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.650703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-898f79cd-f213-4fc3-adea-8b56cf303107 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.098423 Sep 02 21:32:35.651286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 472/890] 10.222.0.99 () {58 vars in 1155 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:35.664391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:35.665063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-37f700cb-45fa-4eca-8158-c6102102ed94 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac426d0d0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.672374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eeb41dd0-bf69-494f-a4e2-84f74322337c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1680 microversion: 2.1 time: 0.436632 Sep 02 21:32:35.672949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 419/891] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:35.755882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-37f700cb-45fa-4eca-8158-c6102102ed94 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092700 Sep 02 21:32:35.757525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 473/892] 10.222.0.99 () {58 vars in 1188 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:35.768569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ea4915d-c1e1-4e6b-98f0-3eefa98cbb26 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] Calling method '.version_select at 0x7faac09d7160>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.854013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ea4915d-c1e1-4e6b-98f0-3eefa98cbb26 tempest-VolumesTestJSON-48714600 tempest-VolumesTestJSON-48714600-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089340 Sep 02 21:32:35.854591 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 420/893] 10.222.0.99 () {58 vars in 1155 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:36.696841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:36.697561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:36.705079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:36.705573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:36.706125 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:36.707701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:36.708168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:36.708594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:36.852851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:36.860711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d40199fa-2690-4f66-8a37-020ee79c9838 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1680 microversion: 2.1 time: 0.168365 Sep 02 21:32:36.861347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 474/894] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:36 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:37.187134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d45104-6397-4740-ad90-b74822d88474", "name": "network-vif-deleted", "tag": "2597c8d6-b463-450f-a8ab-cecf96eb5db0"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:37.197707 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.198272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.202271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.210370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] Creating event network-vif-deleted:2597c8d6-b463-450f-a8ab-cecf96eb5db0 for instance d6d45104-6397-4740-ad90-b74822d88474 on hv-cinder-85221 Sep 02 21:32:37.216318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0d6f510e-827f-4ab6-833a-7a58d74caf2a req-6e0af8e2-aa9f-41ec-8167-b448cbad15ac service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038041 Sep 02 21:32:37.217014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 421/895] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:37.885049 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:37.885638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:37.893192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.893831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.894908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.895678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.896078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.896543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.930070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.930547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.930980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.931427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'fault' on Instance uuid d6d45104-6397-4740-ad90-b74822d88474 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:37.977704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:37.986778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9045baf4-e772-42a3-8854-e61a8756532a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 200 len: 1331 microversion: 2.1 time: 0.105182 Sep 02 21:32:37.987246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 475/896] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:37 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:39.012065 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:39.012675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:39.018874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.019588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.019923 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:39.020651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.021081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.021509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:39.035329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 HTTP/1.1 Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:39.037060 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:32:39.038761 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'd6d45104-6397-4740-ad90-b74822d88474'} Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:39.043029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:32:39.044643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:39.048539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:39.048539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c0d8af75-6d04-478e-8778-aa354170f19e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 404 len: 111 microversion: 2.1 time: 0.031297 Sep 02 21:32:39.048539 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 422/897] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:39 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:39.048800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9824cba2-3a40-4a2e-a0ef-1d59f9fb5cc3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '.version_select at 0x7faac0cd8f70>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:39.180760 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9824cba2-3a40-4a2e-a0ef-1d59f9fb5cc3 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508569582" status: 202 len: 0 microversion: 2.1 time: 0.136953 Sep 02 21:32:39.181367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 476/898] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508569582 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:40.056018 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:40.065682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:40.065682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.065682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.065682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.066778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.066778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.066778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.151766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'services' on Instance uuid f7a53988-5e75-44d2-9cb2-6f5c31e2144d {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:40.404370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7b18c32c-35e3-4b5b-8bf0-690d18d9d165 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments/92baa626-20d1-4d34-adb5-39d590afcb9d" status: 202 len: 0 microversion: 2.1 time: 0.351991 Sep 02 21:32:40.405190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 423/899] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:32:40 2022] DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments/92baa626-20d1-4d34-adb5-39d590afcb9d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:40.415027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:40.417926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:40.424824 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.425877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.426314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.427022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.427470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.427894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.460469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c076a0c5-4b3f-49e5-9e47-ae86f73394af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050144 Sep 02 21:32:40.461051 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 477/900] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:32:40 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:41.473446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:41.475986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:41.483028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.484359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.484359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.484685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.485142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.485573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.517391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4d84e25-5eea-4d8f-9e83-865ceba9ffa8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048385 Sep 02 21:32:41.522719 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 424/901] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:32:41 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:42.531522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:42.533426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:42.540076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.540561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.540997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.541764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.542219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.542644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.573515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3c2a8e4b-46f2-43f7-8e97-a98a90f59e02 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046885 Sep 02 21:32:42.574117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 478/902] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:32:42 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:32:42.647431 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:42.648265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:42.654464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.654955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.655391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.656363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.656856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.657291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.684609 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:42.716225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:43.051375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c7a51a72-8332-47cf-96b8-e25c72910f93 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 204 len: 0 microversion: 2.1 time: 0.407548 Sep 02 21:32:43.052073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 425/903] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:32:42 2022] DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:32:43.060383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:43.061003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:43.067608 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.068107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.068586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.069290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.069841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.070746 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.210879 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:43.218852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-85446533-6888-4497-bdf8-19a3a0e13920 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1681 microversion: 2.1 time: 0.162273 Sep 02 21:32:43.219442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 479/904] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:43 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:44.244330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:44.245094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:44.255035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.256091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.256986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.258411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.259265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.260071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.430661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:44.436613 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6d243ff-bb97-4445-802c-ddaf69d3ca23 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1681 microversion: 2.1 time: 0.196315 Sep 02 21:32:44.437300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 426/905] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:44 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:45.249103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a53988-5e75-44d2-9cb2-6f5c31e2144d", "name": "network-vif-deleted", "tag": "d6ba7825-9b7b-4865-a1dd-8cb3cb034b49"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:45.259417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.259899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.260328 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.433764 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] Creating event network-vif-deleted:d6ba7825-9b7b-4865-a1dd-8cb3cb034b49 for instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d on hv-cinder-85221 Sep 02 21:32:45.440138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d8f8a5ff-5891-4e0c-b11f-0b1132950d23 req-c996f2a4-d6d9-44ec-872b-f47285848288 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194399 Sep 02 21:32:45.441557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 480/906] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:45.472052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:45.478103 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:45.491370 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.492496 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.493142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.494390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.495770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.496544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.576301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:45.586409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7dc20df4-18c9-423e-b6a6-6f6aba6c63e8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1326 microversion: 2.1 time: 0.125429 Sep 02 21:32:45.587128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 427/907] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:45 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:46.612419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:46.613226 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:46.619867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.620351 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.620784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.621486 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.621960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.622414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.657640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.658162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.658603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.659060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'fault' on Instance uuid f7a53988-5e75-44d2-9cb2-6f5c31e2144d {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:46.701121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:46.709756 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a03892c7-2fd8-4814-a52d-c08d6c9f7656 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 200 len: 1331 microversion: 2.1 time: 0.102258 Sep 02 21:32:46.710475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 481/908] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:46 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:47.736675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:47.737333 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:47.740503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:47.745329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.745849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.746294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.746993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.747451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.747879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.761766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d HTTP/1.1 Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:32:47.763495 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:32:47.765118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'f7a53988-5e75-44d2-9cb2-6f5c31e2144d'} Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:47.766017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:32:47.767435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:32:47.768703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:47.768703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1e79cd28-04cc-4c50-9d29-c43b473b7ede tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 404 len: 111 microversion: 2.1 time: 0.032149 Sep 02 21:32:47.768703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 428/909] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:47 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:47.774093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0ad7f1e6-f22c-44ff-ac9c-68076f3da3fc tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '.version_select at 0x7faac4284dc0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:47.781368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:47.938138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0ad7f1e6-f22c-44ff-ac9c-68076f3da3fc tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224085382" status: 202 len: 0 microversion: 2.1 time: 0.167737 Sep 02 21:32:47.938709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 482/910] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224085382 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:48.876332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c692bc1f-3da4-4649-acb9-5215d084ff41 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: .version_select at 0x7faac0f26ee0>, body: {"keypair": {"name": "tempest-keypair-517719187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD33CKw381rX0sVY8h5W8IQJcMR7w4SFrctfFR7r8jZJs6GILq3VsiZp/ztB4LgSJRwpAXvKniQjcugGcO4ybrymyAE5/WOpytq3SzDd8fTf7MYeihOpqKIEWlG3+4gr8A=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:48.893486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c692bc1f-3da4-4649-acb9-5215d084ff41 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:48.899450 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-c692bc1f-3da4-4649-acb9-5215d084ff41 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:49.005395 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c692bc1f-3da4-4649-acb9-5215d084ff41 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132842 Sep 02 21:32:49.006052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 429/911] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:32:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:51.754697 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-731917571", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "315bf927-f303-4323-bf17-32171d1e63b8"}], "security_groups": [{"name": "tempest-securitygroup--622472204"}], "key_name": "tempest-keypair-517719187", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:51.903666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] validate_networks() for [('315bf927-f303-4323-bf17-32171d1e63b8', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:32:52.376519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:32:52.376975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:32:52.377470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:32:52.377939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:32:52.378753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:32:52.387941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:52.388431 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:52.388894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:52.389631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:52.390122 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:52.390590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:52.410767 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:52.415666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:52.428306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:32:52.431019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:32:52.605819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d7fa7304-1ba5-4cae-a4d9-9c8babb1e618 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.857220 Sep 02 21:32:52.606598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 483/912] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:32:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:32:52.617937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-227a8fcd-d853-4573-8af3-a3c581058672 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:52.618666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-227a8fcd-d853-4573-8af3-a3c581058672 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:52.684944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-227a8fcd-d853-4573-8af3-a3c581058672 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:52.694785 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-227a8fcd-d853-4573-8af3-a3c581058672 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1240 microversion: 2.1 time: 0.080714 Sep 02 21:32:52.695481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 430/913] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:52 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:53.718450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:53.719264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:53.726795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.727293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.727736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:53.728459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.728924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.729354 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:53.732301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:53.812306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:53.821401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cc99b7a4-4717-4edc-8927-b9fb44ca790f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1244 microversion: 2.1 time: 0.107391 Sep 02 21:32:53.822033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 484/914] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:53 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:54.844551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:54.845109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:54.852726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:54.853212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:54.853649 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:54.854373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:54.854827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:54.855254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:54.917038 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:54.924854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-95cb1fc0-3401-4492-a63e-4abf0019c27c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1292 microversion: 2.1 time: 0.084283 Sep 02 21:32:54.925509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 431/915] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:54 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:55.947773 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:55.948508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:55.955720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.956209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.957220 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:55.958171 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.958635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.959080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:56.039563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:56.050786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-897407b7-3518-4b78-8f7b-7c51b22b3f52 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1298 microversion: 2.1 time: 0.106550 Sep 02 21:32:56.051719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 485/916] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:55 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:57.077051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:57.077637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:57.085705 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:57.086309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:57.086757 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.087471 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:57.087932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:57.088384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.239062 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:57.247486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-23a07e48-ea1d-419d-ad71-7f9ff9124290 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.174566 Sep 02 21:32:57.248190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 432/917] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:57 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:57.325780 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8ac4fe-677d-40b0-a232-2bac3efd019d", "tag": "58fbdf95-2275-437c-aa59-cac7abcb6417"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:57.336933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:57.337362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:57.337830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.351726 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] Creating event network-changed:58fbdf95-2275-437c-aa59-cac7abcb6417 for instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d on hv-cinder-85221 Sep 02 21:32:57.357213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-78f6ffe2-6bc9-4be3-ba6b-0ed93dc9938a req-a535c7c8-7023-4bce-8098-3b155c0401e9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035075 Sep 02 21:32:57.357853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 486/918] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:58.277039 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:58.279892 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:58.293602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.294900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.295745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:58.297275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.298421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.300920 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:58.495377 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:58.505279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cc88b069-ba1e-425a-94b7-269965025c7c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.236870 Sep 02 21:32:58.506519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 433/919] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:58 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:59.530274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:59.531289 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:59.538471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:59.538870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:59.539360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:59.540086 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:59.540574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:59.541039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:59.682209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:59.690058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-45b7c289-c874-44a0-9bb5-cd516eb2bed2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.164863 Sep 02 21:32:59.690637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 487/920] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:59 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:33:00.713895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:00.714503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:00.721197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.721677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.722822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.723549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.724006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.724432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.868038 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:00.879578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7311abda-14fb-4532-8249-ecd8b64a3a9d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.168552 Sep 02 21:33:00.879968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 434/921] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:00 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:01.902267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:01.902849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:01.910883 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.911378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.911819 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:01.912527 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.912983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.913412 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:02.050999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:02.060243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6cc2a6c8-d1d2-4649-9307-ea92ab9c05bd tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.161951 Sep 02 21:33:02.060837 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 488/922] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:01 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:33:03.097870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:03.097870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:03.100412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:03.105647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.106175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.106614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.107327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.107787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.108217 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.261295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:03.282340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d0d31fcb-2570-4f7a-9dbf-988ffb3dfa31 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.188586 Sep 02 21:33:03.286494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 435/923] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:03 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:04.308875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:04.308875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:04.309450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:04.310182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:04.316216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.316979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.317431 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:04.318184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.318648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.319082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:04.467836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:04.477494 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cab09f0a-ec38-46f8-8e5a-2a847f2a36af tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.174566 Sep 02 21:33:04.478130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 489/924] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:04 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:05.119260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8ac4fe-677d-40b0-a232-2bac3efd019d", "name": "network-vif-plugged", "status": "completed", "tag": "58fbdf95-2275-437c-aa59-cac7abcb6417"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:05.131787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:05.132366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:05.132872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.145782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] Creating event network-vif-plugged:58fbdf95-2275-437c-aa59-cac7abcb6417 for instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d on hv-cinder-85221 Sep 02 21:33:05.151030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-cb8d59fc-b891-4b8c-a8a6-5bdc2cb7f37a req-b8fba9c4-0f8c-4cd4-ae73-aa0f5e7fbb9a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036961 Sep 02 21:33:05.160390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 436/925] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:05.500281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:05.500895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:05.508481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:05.508978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:05.509415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.510167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:05.510621 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:05.511104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.666741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:05.677911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-93800bcc-452c-4930-9277-8dd8ebebac14 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.181452 Sep 02 21:33:05.679121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 490/926] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:05 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:06.702647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:06.703381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:06.709884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.710376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.710811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.711510 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.711962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.712387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.858095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:06.866810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-71f011a8-ee20-486c-ad4d-08f2311a4ffb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.169013 Sep 02 21:33:06.867407 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 437/927] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:06 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:33:07.890210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:07.891432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:07.897853 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.898347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.898794 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.899503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.899962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.900390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:08.041217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:08.049460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9af96baf-03ea-4c02-9303-31ce8ae208d2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1365 microversion: 2.1 time: 0.163206 Sep 02 21:33:08.051248 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 491/928] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:07 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:09.076804 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:09.077446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:09.084378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.084994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.085810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.086153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.086608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.087047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.223573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:09.231656 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e022bb8a-13ca-4f69-a603-d58ab248d29b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1554 microversion: 2.1 time: 0.158881 Sep 02 21:33:09.232243 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 438/929] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:09 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:09.254231 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:09.254968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:09.261623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.262143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.262680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.263288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.263731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.264158 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.350660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ae11d696-e543-4aa7-97ca-36eb93196df1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100321 Sep 02 21:33:09.353820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 492/930] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:33:09 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:10.450051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8ac4fe-677d-40b0-a232-2bac3efd019d", "tag": "58fbdf95-2275-437c-aa59-cac7abcb6417"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:10.461328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:10.461848 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:10.462291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:10.474700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] Creating event network-changed:58fbdf95-2275-437c-aa59-cac7abcb6417 for instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d on hv-cinder-85221 Sep 02 21:33:10.480090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-60a688be-a115-4611-852d-ad51244d970a req-7962cdd4-967d-434f-b20e-f97b6bdde15e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033567 Sep 02 21:33:10.480699 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 439/931] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:18.806915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:18.807587 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:18.813703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:18.814227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:18.814677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:18.815408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:18.816025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:18.816459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:18.841127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e876a93-a7af-412c-b576-5119ae732208 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/ips" status: 200 len: 152 microversion: 2.20 time: 0.039047 Sep 02 21:33:18.841744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 493/932] 10.222.0.99 () {60 vars in 1289 bytes} [Fri Sep 2 21:33:18 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:33:22.152922 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:22.153682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:22.158213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:22.158849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:22.166399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:22.166399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:22.166399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:22.168382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:22.168382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:22.168382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:22.192125 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lazy-loading 'flavor' on Instance uuid a6200de3-d8cd-4c5c-83fd-feb09e67d285 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:33:22.779726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-77bcc65b-d0c7-4dc8-80e4-7889220bf603 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/action" status: 202 len: 0 microversion: 2.20 time: 0.627947 Sep 02 21:33:22.780368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 440/933] 10.222.0.99 () {62 vars in 1319 bytes} [Fri Sep 2 21:33:22 2022] POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:33:22.790028 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:22.793847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:22.793847 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:22.798194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:22.798684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:22.799190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:22.800581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:22.800581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:22.801317 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:22.938628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:22.947418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:22.948851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:22.950037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cc837f68-9206-4a86-b754-2c74f9025892 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.164050 Sep 02 21:33:22.961640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 494/934] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:22 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:23.977941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:23.978645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:23.984938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:23.985423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:23.985896 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:23.986592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:23.987048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:23.987992 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:24.120240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:24.129693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:24.131155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:24.132352 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-088b7699-3a09-461a-bb9f-e5095b187d9c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.159222 Sep 02 21:33:24.132919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 441/935] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:23 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:33:25.158205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:25.158727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:25.165274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:25.165788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:25.166224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:25.166919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:25.167369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:25.167792 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:25.298055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:25.306080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:25.307493 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:25.308641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-168e21c4-b1eb-4900-97e8-31bbb1169549 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.155187 Sep 02 21:33:25.309193 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 495/936] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:25 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:26.334914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:26.335523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:26.342109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:26.342596 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:26.343033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:26.343722 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:26.344870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:26.345305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:26.478801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:26.487022 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:26.488476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:26.489635 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2f37bb4-99ce-453b-9955-b725a3650d7e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.159153 Sep 02 21:33:26.490317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 442/937] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:26 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:27.515530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:27.518881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:27.523215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:27.523710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:27.524150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:27.524917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:27.525373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:27.525839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:27.528553 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=64 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:27.662604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:27.670586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:27.676228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:27.676228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-32c0ef96-0775-4bc8-a4af-f9a07f4de65c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.162114 Sep 02 21:33:27.676228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 496/938] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:27 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:28.698751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:28.699367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:28.705918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:28.708771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:28.708771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:28.708771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:28.708771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:28.709134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:28.842974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:28.851216 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:28.857551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:28.857551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7f62b204-72b0-4a2f-a797-ff67e2fdcb2c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.158995 Sep 02 21:33:28.857551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 443/939] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:28 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:29.879108 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:29.879747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:29.886176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:29.890489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:29.890489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:29.890489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:29.890489 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:29.890887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:30.041458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:30.049858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:30.054789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:30.054789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9f69420f-ed4a-4fd6-a7a7-772d11bc6998 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.177449 Sep 02 21:33:30.054789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 497/940] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:29 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:31.078253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:31.078858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:31.085571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:31.086086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:31.086526 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:31.087208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:31.087669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:31.088093 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:31.234605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:31.245323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:31.246837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:31.248023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a140ffc7-2d32-4292-9e6a-3fb169765929 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.173840 Sep 02 21:33:31.248598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 444/941] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:31 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:32.274574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:32.275186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:32.281927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:32.282383 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:32.282821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:32.283511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:32.284001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:32.284418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:32.438562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:32.447837 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:32.449502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:32.450693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-daf9bc07-98f1-457e-9839-732a36d96f91 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.180291 Sep 02 21:33:32.451258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 498/942] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:32 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:33.475721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:33.476336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:33.482852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:33.483359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:33.483794 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:33.484494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:33.484953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:33.485584 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:33.623121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:33.633605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:33.634594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:33.635783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f674aa4f-87d8-4938-8d3d-efe3f85863fc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.164498 Sep 02 21:33:33.636353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 445/943] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:33 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:34.668480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:34.669131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:34.682563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:34.682563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:34.682563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:34.682563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:34.682893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:34.682893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:34.816508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:34.825522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:34.827006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:34.828323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0877bb0b-152f-4cb9-b3fc-fbbae8bd4aa7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.163818 Sep 02 21:33:34.828893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 499/944] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:34 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:35.853615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:35.854284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:35.860974 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:35.863191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:35.863191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:35.863191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:35.863191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:35.863789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:35.998785 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:36.007967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:36.009411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:36.010631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cf7dd369-f7a4-4743-b2d5-46bb42d1d955 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.160958 Sep 02 21:33:36.011196 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 446/945] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:35 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:37.038459 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:37.039155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:37.046596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:37.047102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:37.047551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:37.048663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:37.048751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:37.049141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:37.252812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:37.262901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:37.264503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:37.265769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-136e0ec1-6df6-4fae-a681-95452a4dc88e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.232449 Sep 02 21:33:37.266347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 500/946] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:37 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:38.305129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:38.305696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:38.311954 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:38.312438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:38.312872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:38.313624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:38.314119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:38.314543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:38.455670 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:38.472779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:38.472779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:38.472779 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f2799e32-b4bd-49ed-b9ea-66532814048c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.168327 Sep 02 21:33:38.473080 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 447/947] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:38 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:39.498649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:39.499268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:39.506020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:39.507646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:39.507646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:39.507646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:39.508124 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:39.508519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:39.667107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:39.682091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:39.683858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:39.685146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d5f8f49a-9c62-4efe-8caa-66cecd7518a0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.191795 Sep 02 21:33:39.685944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 501/948] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:39 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:40.711151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:40.711784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:40.718547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:40.719039 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:40.719478 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:40.720282 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:40.720784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:40.721358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:40.865657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:40.875043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:40.876823 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:40.878102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-27a79c58-e735-43ef-8c02-c5f87680dcf8 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.171371 Sep 02 21:33:40.878678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 448/949] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:40 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:41.106387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "name": "network-vif-plugged", "status": "completed", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:41.118132 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:41.118623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:41.119057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:41.132230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] Creating event network-vif-plugged:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:33:41.137335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-3b6d07a5-7576-42d8-84c0-7eef1ba1615f req-d5063c47-91e4-4c31-8a09-e6066371a15b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Sep 02 21:33:41.137977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 502/950] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:41.905119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:41.905798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:41.913605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:41.914122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:41.914552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:41.915253 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:41.915698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:41.916120 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:42.062001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:42.072798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:42.074324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:42.075483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a8b3b37a-c5a7-47e6-b567-f0c99d3268c6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.174841 Sep 02 21:33:42.076044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 449/951] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:41 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:43.103583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:43.104273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:43.111179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:43.111701 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:43.112162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:43.112939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:43.114969 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:43.116088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:43.270152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:43.282882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:43.286000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:43.289128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3bf2a522-7d40-4933-90a1-0b5b4364752b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1745 microversion: 2.20 time: 0.190383 Sep 02 21:33:43.290542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 503/952] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:43 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:44.317486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:44.320303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:44.328311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:44.328812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:44.329276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:44.330021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:44.330489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:44.330937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:44.544243 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:44.557460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:44.559586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:44.560895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-899e584c-14cc-4636-bded-6ea08878372c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.248346 Sep 02 21:33:44.561550 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 450/953] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:44 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:45.595228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:45.596206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:45.613346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:45.614570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:45.615586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:45.617529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:45.619371 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:45.620336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:45.864831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:45.875648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:45.877895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:45.879612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d13cce8d-a951-4adc-a95a-70435c35699e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.291207 Sep 02 21:33:45.880775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 504/954] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:45 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:46.906353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:46.907353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:46.915668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:46.918211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:46.919141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:46.920214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:46.920696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:46.921362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:47.242130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:47.250910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:47.253136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:47.269847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-66147112-7e30-4935-ac39-54ed616c8a76 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.352578 Sep 02 21:33:47.269847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 451/955] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:46 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:48.284223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:48.284898 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:48.292490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:48.293239 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:48.293498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:48.294281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:48.294745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:48.295207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:48.441312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:48.450069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:48.451519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:48.452686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e9f3bfd8-15f3-4585-9bbb-7f80c450c521 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.173903 Sep 02 21:33:48.453249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 505/956] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:48 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:49.488148 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:49.489053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:49.498396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:49.498912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:49.499367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:49.500138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:49.500624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:49.501258 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:49.663583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:49.678813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:49.681909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:49.683877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2fc5e7eb-998c-4d47-887d-b14c73944018 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.206281 Sep 02 21:33:49.684497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 452/957] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:49 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:50.712009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:50.712620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:50.719233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:50.719975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:50.720632 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:50.721355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:50.721843 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:50.722490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:50.902224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:50.910829 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:50.913343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:50.914983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1074e50c-f125-4bb7-8dcc-214ddc51ba65 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.207160 Sep 02 21:33:50.915555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 506/958] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:50 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:51.942440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:51.943555 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:51.950420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:51.950925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:51.951373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:51.952220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:51.952686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:51.953120 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:52.112237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:52.123881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:52.125655 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:52.127657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f53f01ce-ac43-42f0-9b18-173979737c5a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.189166 Sep 02 21:33:52.128260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 453/959] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:51 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:53.174311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:53.174882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:53.183166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:53.183651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:53.184087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:53.188418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:53.188418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:53.188418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:53.379933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:53.394488 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:53.395972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:53.397921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-adb585af-d11c-4d9a-b732-b88326e272b6 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.227884 Sep 02 21:33:53.405693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 507/960] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:53 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:54.431104 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:54.432018 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:54.434643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=29 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:54.439468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:54.439964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:54.440414 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:54.441129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:54.441597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:54.442072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:54.445847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:54.594445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:54.604210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:54.605683 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:54.606897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-70793f3f-2558-47d3-878a-3f7e9a11acf2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.180887 Sep 02 21:33:54.607659 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 454/961] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:54 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:55.650808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:55.651620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:55.660283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=28 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:55.662848 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:55.663444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:55.663957 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:55.664951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:55.665774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:55.666283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:55.836141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:55.846057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:55.847666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:55.848917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8a4f141a-6843-411a-9141-2f647b819d6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.215438 Sep 02 21:33:55.850195 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 508/962] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:55 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:56.876017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:56.877319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:56.885456 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:56.885987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:56.886410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:56.887106 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:56.887561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:56.887994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:57.059280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:57.071338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:57.073348 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:57.074946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5b6b9375-9ec0-4d9c-8b46-a1183822c12a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.203233 Sep 02 21:33:57.075668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 455/963] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:56 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:33:58.104132 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:58.104770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:58.111482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:58.111971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:58.112415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:58.113143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:58.113606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:58.114095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:58.117331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=74 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:58.262818 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:58.272012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:58.274762 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:58.275299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-40e1a662-e463-4f72-9288-89a4d6a793c0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.175074 Sep 02 21:33:58.275933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 509/964] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:58 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:33:59.301949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:59.303155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:59.309242 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:59.309731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:59.310184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:59.310871 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:59.311325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:59.311743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:59.445660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:59.454047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:59.455768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:59.456863 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e86d4db5-7da9-467f-8e9a-276c66d7fe96 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.159422 Sep 02 21:33:59.457418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 456/965] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:33:59 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:00.496464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:00.499480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:00.503618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:00.504104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:00.504542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:00.505241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:00.506921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:00.507359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:00.644477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:00.653260 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:00.654721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:00.655892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cbc5041a-b350-42b8-b042-0d488e249408 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1740 microversion: 2.20 time: 0.163410 Sep 02 21:34:00.656444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 510/966] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:00 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:01.683410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:01.683989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:01.690402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:01.690887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:01.691322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:01.692023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:01.692476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:01.693600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:01.838976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:01.847329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:01.848768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:01.850549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-110e037f-c7a3-45bf-b73e-63c8e11b13d7 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1722 microversion: 2.20 time: 0.171339 Sep 02 21:34:01.851099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 457/967] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:01 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:02.878149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:02.878793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:02.886003 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:02.886501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:02.886942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:02.887678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:02.888141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:02.888568 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:03.031246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:03.040480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:03.041995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:03.043181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e06072dc-ff10-4721-979c-37f4da81fb8a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1722 microversion: 2.20 time: 0.169126 Sep 02 21:34:03.043747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 511/968] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:02 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:03.148953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "name": "network-vif-unplugged", "status": "completed", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:03.159962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:03.160452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:03.160889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:03.172959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] Creating event network-vif-unplugged:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:34:03.178703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0a55be71-7666-41ed-9aef-0670e3b3b299 req-46a04c49-0431-4e6d-a7e6-1072b210daba service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033581 Sep 02 21:34:03.179435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 458/969] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:04.071009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:04.071561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:04.078208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:04.078719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:04.079176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:04.079880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:04.080334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:04.080873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:04.237693 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:04.250753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:04.254942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:04.254942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a0f8678-ea9c-419b-bda2-ab778e940a29 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1725 microversion: 2.20 time: 0.187782 Sep 02 21:34:04.254942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 512/970] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:04 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:04.298460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e19afdc0-04f9-4968-87f1-7bb3143e9a9e"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:04.302425 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:04.320043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:04.320553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:04.321005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:04.321841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:04.323460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:04.323460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:05.417664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4fc972f0-6390-4fd2-9d86-a00f73dd872d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.124332 Sep 02 21:34:05.418409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 459/971] 10.222.0.99 () {62 vars in 1364 bytes} [Fri Sep 2 21:34:04 2022] POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments => generated 188 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:34:05.554217 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:05.555842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:05.565075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:05.565566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:05.566037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:05.566749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:05.567202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:05.567630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:09.604281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a5be7265-520b-4e43-9eb1-04edadf11736 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments/e19afdc0-04f9-4968-87f1-7bb3143e9a9e" status: 202 len: 0 microversion: 2.20 time: 4.054854 Sep 02 21:34:09.604917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 513/972] 10.222.0.99 () {60 vars in 1457 bytes} [Fri Sep 2 21:34:05 2022] DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments/e19afdc0-04f9-4968-87f1-7bb3143e9a9e => generated 0 bytes in 4056 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:34:09.670260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:09.674597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:09.677569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:09.678225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:09.678685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:09.679405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:09.679866 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:09.680351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:09.712711 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121277) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:34:10.024728 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [a50923ee-d479-48cd-8e29-eb6108af0a18] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 21:34:11.033061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [a50923ee-d479-48cd-8e29-eb6108af0a18] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 35006. Sep 02 21:34:11.036324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-75a71b2a-5b7e-4ba0-9796-15e63b80436b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/action" status: 202 len: 0 microversion: 2.20 time: 1.370056 Sep 02 21:34:11.037183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 460/973] 10.222.0.99 () {62 vars in 1319 bytes} [Fri Sep 2 21:34:09 2022] POST /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/action => generated 0 bytes in 1371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:34:11.045667 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:11.046315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:11.053372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:11.053911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:11.054354 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:11.055073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:11.055581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:11.055962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:11.198362 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:11.206523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:11.207989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:11.209742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6f26789c-bc08-4b4e-9f77-0ca1753857be tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1673 microversion: 2.20 time: 0.168289 Sep 02 21:34:11.210306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 514/974] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:11 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:12.235905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:12.237591 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:12.244201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:12.244742 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:12.245206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:12.245968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:12.246435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:12.246865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:12.381179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:12.389521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:12.391011 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:12.392176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8cb3a084-3c9a-4ee4-bbe1-9d9cd7605151 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1673 microversion: 2.20 time: 0.160793 Sep 02 21:34:12.392822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 461/975] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:12 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:13.418991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:13.419605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:13.426295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.426812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.427992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.428825 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.429316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.429788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.564430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:13.573698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:13.575182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:13.576364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e3e6c596-324e-4a93-9158-b59e4f720dcc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.161594 Sep 02 21:34:13.576927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 515/976] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:13 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:13.710889 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:13.711477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:13.718358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.718848 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.719286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.719983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.720436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.720858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.744506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-036f6c3f-dd84-4ea8-a143-aee31fa7c991 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/ips" status: 200 len: 145 microversion: 2.1 time: 0.037509 Sep 02 21:34:13.745081 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 462/977] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:34:13 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:14.603271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:14.603873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:14.610714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:14.612881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:14.612881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:14.612881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:14.612881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:14.613840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:14.793262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:14.811191 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:14.813337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:14.815063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e8566cc4-7167-4e98-a5dd-c098fd8f0d70 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.215940 Sep 02 21:34:14.816160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 516/978] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:14 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:15.846795 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:15.847507 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:15.856162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:15.856662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:15.857107 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:15.857852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:15.858315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:15.858941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:16.008645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:16.017122 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:16.018621 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:16.019805 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-49a3ca9d-62a8-4969-b6fb-bc38a613aa6f tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.179314 Sep 02 21:34:16.020371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 463/979] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:15 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:16.482909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a626d0e0-75d1-4e22-aa5f-95225d233502"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:16.487502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:16.496844 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:16.501867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:16.501867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:16.501867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:16.501867 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:16.502233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.047375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:17.047995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:17.055467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:17.055963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:17.056410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.057124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:17.057587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:17.058040 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.203027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:17.212098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:17.213563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:17.214784 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5169ce29-134b-43ca-96a5-738486141a06 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.171376 Sep 02 21:34:17.215363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 464/980] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:17 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:18.243113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:18.244822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:18.252643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:18.253742 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:18.258104 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:18.259460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:18.260175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:18.260859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:18.422623 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:18.443498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:18.449688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:18.451175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b6aee625-e6d9-48dd-8850-bdf3ede3a320 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.213041 Sep 02 21:34:18.452252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 465/981] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:18 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:19.477803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:19.478588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:19.485943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.486542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.487071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.488058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.488769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.489300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.634860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:19.644433 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:19.646901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:19.648619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-078fc399-0121-45cb-9d6c-1f472e514f49 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.176006 Sep 02 21:34:19.659336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 466/982] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:19 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:20.675403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:20.676138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:20.683145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:20.683634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:20.684074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:20.684773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:20.685229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:20.685666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:20.828203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:20.836786 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:20.838292 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:20.839462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0593fe7e-3cf6-4b35-8c47-64e4186298cc tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.167972 Sep 02 21:34:20.840024 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 467/983] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:20 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:21.864830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:21.866302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:21.873657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:21.874693 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:21.874801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:21.875541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:21.876075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:21.876595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:21.879814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:22.028225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:22.039308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:22.043375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:22.044853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fab5a398-3bba-46e2-97ed-f075fcb2d37b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.184117 Sep 02 21:34:22.051009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 468/984] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:21 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:23.071459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:23.072232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:23.078753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:23.079240 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:23.079677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:23.080376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:23.080828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:23.081254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:23.276852 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:23.285354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:23.286838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:23.288608 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d89fd62e-ec35-4866-8fc5-14e1c27e3c0e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.220521 Sep 02 21:34:23.289469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 469/985] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:23 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:24.314768 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:24.315447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:24.322868 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.323188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.323642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.324347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.324806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.325238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.456833 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:24.466203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:24.467713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:24.468898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ef802a3-73dd-4cb9-899f-f9cfcd40b50d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.158223 Sep 02 21:34:24.469453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 470/986] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:24 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:25.498109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:25.498854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:25.504594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:25.507400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.508273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.508963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.509989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.510702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.518204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.681908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:25.690210 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:25.691672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:25.692841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b8d7e3d5-7691-4739-80d5-0bb7bd5e2ef0 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.202409 Sep 02 21:34:25.693478 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 471/987] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:25 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:26.494607 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=19 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:26.597559 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:26.719810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:26.720583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:26.732017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.732518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.732969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.733698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.734188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.734740 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.872412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:26.881126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:26.883147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:26.884371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-47e66198-7044-4305-84f9-5d43fb90ef6e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.168824 Sep 02 21:34:26.884938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 472/988] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:26 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:27.910914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:27.911593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:27.918731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:27.919221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:27.919665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:27.920362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:27.920822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:27.921257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.057146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:28.067077 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:28.068538 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:28.070442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7adcff12-b16a-457b-b760-1a5aecfda55b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.163630 Sep 02 21:34:28.071007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 473/989] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:27 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:29.096732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:29.097584 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:29.104146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.104643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.105105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.105865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.106314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.106750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.242021 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:29.250267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:29.251949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:29.253138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1bdedefc-108c-4893-830f-b108ef4ab2a4 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.160420 Sep 02 21:34:29.253701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 474/990] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:29 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:30.279325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:30.280047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:30.286752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.287241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.288479 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.289238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.289638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.290102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.428016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:30.501913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:30.504217 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:30.505427 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-29643550-1df3-4424-99b5-a7c7ae61b6a3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.230221 Sep 02 21:34:30.506033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 475/991] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:30 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:31.534870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:31.534870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:31.543682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:31.544487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:31.545028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:31.545840 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:31.546710 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:31.547213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:31.714776 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:31.724150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:31.726269 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:31.727642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9cf63898-05a7-431d-9430-d1f15ea89eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.198700 Sep 02 21:34:31.728229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 476/992] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:31 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:34:32.223880 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f377c6eb-887c-4021-b573-4030f3594c51 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.746194 Sep 02 21:34:32.224586 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 517/993] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:34:16 2022] POST /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 194 bytes in 15749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:32.755510 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:32.756135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:32.763477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:32.775729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:32.775729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:32.775729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:32.775729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:32.776510 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:32.927443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:32.937128 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:32.947633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:32.947633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b99b680e-86d1-4651-8465-9007ec22e26d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.188278 Sep 02 21:34:32.947633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 477/994] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:32 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:33.689221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "name": "network-vif-plugged", "status": "completed", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:33.704753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:33.705605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:33.706201 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:33.717507 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] Creating event network-vif-plugged:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:34:33.722506 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-588b89ce-fc8c-4216-8304-ee861a509147 req-5ad0d804-d9f4-470f-b46f-cec50cd2f931 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043715 Sep 02 21:34:33.723465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 518/995] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:34:33.966427 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:33.967047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:33.974263 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:33.974762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:33.975798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:33.976513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:33.976967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:33.977391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:34.126762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:34.136407 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:34.137895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:34.139089 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7a129cec-90b1-43a5-8a2c-0886f8f512f2 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.176679 Sep 02 21:34:34.139726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 478/996] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:33 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:35.332040 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:35.332785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:35.339505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:35.339998 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:35.340437 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:35.341167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:35.341624 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:35.342082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:35.482642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:35.492875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:35.494607 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:35.495775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c91fb2f8-a309-4b89-9594-ebae5327325b tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.334636 Sep 02 21:34:35.496333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 519/997] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:35 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:36.523197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:36.532638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:36.536505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:36.537256 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:36.538326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:36.540619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:36.542379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:36.543155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:36.707044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:36.724390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:36.724390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:36.724390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-48207a35-f72f-47e0-b3dd-f4018a6925aa tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.204366 Sep 02 21:34:36.724735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 479/998] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:36 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:37.755237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:37.755804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:37.763682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:37.764169 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:37.764610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:37.765318 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:37.765804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:37.766240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:37.967305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:37.978164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:37.979938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:37.981580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-153ead12-4a10-47a9-80c6-38d47f318c62 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1731 microversion: 2.20 time: 0.230371 Sep 02 21:34:37.982209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 520/999] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:37 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:39.007200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:39.007860 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:39.014013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:39.014562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:39.014943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:39.015642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:39.016094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:39.016536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:39.174933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:39.185116 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:39.187178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:39.188631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-40bf1740-e01a-446f-b61b-904dce65a80c tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1718 microversion: 2.20 time: 0.185511 Sep 02 21:34:39.189206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 480/1000] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:34:39 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:34:40.986059 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:40.988309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:40.995225 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:40.995712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:40.996150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:40.996865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:40.997317 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:40.997783 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:41.033404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b2fafea3-23af-479d-943b-823a171424a4 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051791 Sep 02 21:34:41.034136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 521/1001] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:34:40 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:41.046162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:41.046759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:41.053610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:41.055030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:41.055897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:41.056801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:41.058288 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:41.058898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:41.092448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9efbab51-d10d-4ad4-959c-3eee647945b7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502" status: 200 len: 194 microversion: 2.1 time: 0.050335 Sep 02 21:34:41.094813 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 481/1002] 10.222.0.99 () {58 vars in 1413 bytes} [Fri Sep 2 21:34:41 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:44.117230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffab0fc7-7bdb-4784-bdc4-1efa7b0212c9"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:44.119680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:44.126557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:44.126988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:44.127429 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:44.128143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:44.128729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:44.129157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:45.234301 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-29fa0f98-78f0-4406-9554-684c263f34cd tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "POST /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.121519 Sep 02 21:34:45.235020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 522/1003] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:34:44 2022] POST /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:52.504897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=21 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:52.505839 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=83 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:52.736662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f52b4578-003a-42d6-b6cb-b85595475428 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Action: 'create', calling method: .version_select at 0x7faac097e160>, body: {"keypair": {"name": "tempest-TestShelveInstance-516683868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDpDdZwajLwYBkklnff6bljIbrjkdf5rWrIwecH/mk5hrBuNCTGTITdRCdmySbJbsSXlEw/b866SAcGsMz8t6sMBsbo7xOUDDZm67SSQM6Qq4ZSOouiloMwfCbB7eaPCQ=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:52.755599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-f52b4578-003a-42d6-b6cb-b85595475428 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Getting quotas for project ed9e8bc2976f4e2a8f439f89440bdaa3. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:34:52.761649 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-f52b4578-003a-42d6-b6cb-b85595475428 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Getting quotas for user 7984fc2a59704c10905656ae32dc68af and project ed9e8bc2976f4e2a8f439f89440bdaa3. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:34:52.870572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f52b4578-003a-42d6-b6cb-b85595475428 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.370132 Sep 02 21:34:52.871300 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 482/1004] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:34:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:54.039443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:54.042930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:54.050644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.051580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.052296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.053464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.054503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.055412 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.095845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bf780d20-9060-4729-8ac5-709bace895d2 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066974 Sep 02 21:34:54.096535 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 523/1005] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:34:54 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:54.247803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:54.248628 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:54.260707 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.261682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.262593 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.263856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.264667 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.265896 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.328038 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-24ed6547-a5f5-4000-87c6-460c5351780d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502" status: 200 len: 194 microversion: 2.1 time: 0.088483 Sep 02 21:34:54.331381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 483/1006] 10.222.0.99 () {58 vars in 1413 bytes} [Fri Sep 2 21:34:54 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:54.353073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:54.353073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:54.358518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.359316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.360228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.361614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.362279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.363068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.503766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lazy-loading 'services' on Instance uuid 993dfc89-c315-4607-a0d2-1e2733afa8b5 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:54.564396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:54.568537 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:54.576734 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.577290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.577854 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.578615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:54.579235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:54.579679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:54.638994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:34:54.899985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-94dde285-64bc-43bc-9bca-6c7275d80ce6 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502" status: 202 len: 0 microversion: 2.1 time: 0.555789 Sep 02 21:34:54.900727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 524/1007] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:34:54 2022] DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/a626d0e0-75d1-4e22-aa5f-95225d233502 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:34:55.110147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-af6459b0-af8a-4859-bf73-117537eb8688 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 204 len: 0 microversion: 2.1 time: 0.549244 Sep 02 21:34:55.124443 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 484/1008] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:34:54 2022] DELETE /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:34:55.136033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:55.137803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:55.149453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:55.150246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:55.150778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:55.151672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:55.155249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:55.158016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:55.372963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:55.382727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4f6755e9-3cb6-41f4-9c21-2d0da05afe57 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1578 microversion: 2.1 time: 0.256515 Sep 02 21:34:55.383736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 525/1009] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:55 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:56.409885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:56.414001 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:56.418109 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:56.418604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:56.419051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:56.419780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:56.420242 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:56.420678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:56.609605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:56.619544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2bc8a5b8-8101-42cb-b7c1-40238173b2b8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1578 microversion: 2.1 time: 0.214222 Sep 02 21:34:56.620146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 485/1010] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:56 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:57.643766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:57.644546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:57.647878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=17 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:57.654558 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:57.658403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:57.658403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:57.658403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:57.658403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:57.658901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:57.664638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:57.863918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:57.875118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a00749f-690a-4e0c-b074-88be9424774a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1578 microversion: 2.1 time: 0.235417 Sep 02 21:34:57.876938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 526/1011] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:57 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:58.791392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6b5d14-aed2-4682-981c-77f4c379c55a", "name": "network-vif-deleted", "tag": "eca48be6-00d0-402a-bd61-5bf499264906"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:58.815119 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:58.815901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:58.816335 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:58.832154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] Creating event network-vif-deleted:eca48be6-00d0-402a-bd61-5bf499264906 for instance 5c6b5d14-aed2-4682-981c-77f4c379c55a on hv-cinder-85221 Sep 02 21:34:58.838305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-b0441b28-e04a-465a-bb46-13cbd51242d8 req-806b2f86-5b9b-4da7-8ad7-a5c695a17b22 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051909 Sep 02 21:34:58.839645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 486/1012] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:58.900714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:58.901341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:58.909215 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:58.909704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:58.910199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:58.910892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:58.911357 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:58.911787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:59.016102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:59.024332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-054d1c31-dd13-4127-ace6-1112a0b7039c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1511 microversion: 2.1 time: 0.127584 Sep 02 21:34:59.024921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 527/1013] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:58 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:59.301587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:59.304620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:59.309273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:59.310026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:59.312150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:59.312150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:59.312150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:59.312514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:59.345401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-485a63d4-8d20-4069-a7f8-b1fcbd22b405 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/ffab0fc7-7bdb-4784-bdc4-1efa7b0212c9" status: 200 len: 194 microversion: 2.1 time: 0.048096 Sep 02 21:34:59.346045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 487/1014] 10.222.0.99 () {58 vars in 1413 bytes} [Fri Sep 2 21:34:59 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/ffab0fc7-7bdb-4784-bdc4-1efa7b0212c9 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:59.357811 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:59.362024 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:59.364670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:59.365196 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:59.365629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:59.366463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:59.366921 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:59.367344 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:59.470935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lazy-loading 'services' on Instance uuid 993dfc89-c315-4607-a0d2-1e2733afa8b5 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:59.899107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-75d42cbb-023d-4d63-b748-db70ba612a3d tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/ffab0fc7-7bdb-4784-bdc4-1efa7b0212c9" status: 202 len: 0 microversion: 2.1 time: 0.544122 Sep 02 21:34:59.910093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 528/1015] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:34:59 2022] DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments/ffab0fc7-7bdb-4784-bdc4-1efa7b0212c9 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:00.048806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:00.049462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:00.056556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:00.057079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:00.057873 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:00.058602 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:00.059074 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:00.059514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:00.095631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:00.096226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:00.096754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:00.097413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lazy-loading 'fault' on Instance uuid 5c6b5d14-aed2-4682-981c-77f4c379c55a {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:00.150163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:00.167392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-792891fb-1bac-4027-a7f2-0832333eea74 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1231 microversion: 2.1 time: 0.114110 Sep 02 21:35:00.167392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 488/1016] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:00 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:01.184263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:01.184983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:01.191496 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:01.191978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:01.192416 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:01.193107 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:01.193557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:01.194009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:01.227290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:01.227775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:01.228216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:01.228672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lazy-loading 'fault' on Instance uuid 5c6b5d14-aed2-4682-981c-77f4c379c55a {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:01.278219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:01.286939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3fa556f2-2dcc-46a2-9ca7-c2ab237e82f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 200 len: 1231 microversion: 2.1 time: 0.107808 Sep 02 21:35:01.287529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 529/1017] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:01 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:02.188997 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.191324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.199922 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.200415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.200861 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.201569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.202072 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.202504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.213500 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.214401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.227232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.228144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.228927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.230249 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.231118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.231915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.238876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-97c6f558-d142-4c38-9151-1ab5267787e7 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053921 Sep 02 21:35:02.239492 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 489/1018] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:02 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:35:02.259462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-978e53e0-66a7-4086-b5f2-9fc2440225d9 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/ips" status: 200 len: 148 microversion: 2.1 time: 0.053337 Sep 02 21:35:02.260148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 530/1019] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:35:02 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/ips => generated 148 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:02.312631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.313255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.320173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.320446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.321091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.321843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.322530 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.323302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.341484 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] HTTP exception thrown: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Request method failure captured: Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a HTTP/1.1 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnYmDntYRco6laCLnQ3GmSIbkkO7k_nUE_-SDVyBBWuuCoN7Bb4rZmusTKXYHJSOj0xcmyOASchfkVPGUjKEDGYUsb7H7zhmdQArT3Lvqx63IgkaWhiIi6d-g6fyMTBNipKljrkQnNrXa6fMGJYLRU-eY9xroxt0AFHIAKzc9Rt-5yo Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:02.343438 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_beb5b0e674994eabb1e18fde391c2484", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-762479264 Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e9450f3f7527406ab70fcf0b64cab787 Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:35:02.344959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '5c6b5d14-aed2-4682-981c-77f4c379c55a'} Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:02.346014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:35:02.347386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:02.350293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Returning 404 to user: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:02.352391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e181f41e-2567-40ac-b176-0a4cc59cba91 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 404 len: 111 microversion: 2.1 time: 0.043280 Sep 02 21:35:02.364149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 490/1020] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:02 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:02.387872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.394272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.397209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.398698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.399240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.400201 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.400730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.401410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.447346 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1a16866c-257d-44ed-808b-705e41e73bdc tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063134 Sep 02 21:35:02.448476 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 531/1021] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:02 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:35:02.494500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-729793716", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1904457527", "security_groups": [{"name": "tempest-secgroup-smoke-459655726"}], "block_device_mapping_v2": [{"uuid": "966c1f09-3397-45be-b011-78d886172931", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7eb9ec5-d03f-40fe-896f-85a06c8dd029"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:02.535456 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.536052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.543044 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.543655 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.544255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.544869 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.545366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.545820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.580727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:02.632332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] validate_networks() for [('f7eb9ec5-d03f-40fe-896f-85a06c8dd029', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:35:02.770378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:02.915570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-11d31c17-8eda-4e88-a80f-93405e10df44 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 204 len: 0 microversion: 2.1 time: 0.384500 Sep 02 21:35:02.920304 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 532/1022] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:02 2022] DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:35:02.927366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:02.929284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:02.936946 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.937694 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.938378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:02.939323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:02.939993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:02.940629 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:03.156740 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:35:03.157189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:35:03.158473 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:35:03.159651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:35:03.160385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:35:03.171561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:03.172062 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:03.172564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:03.173314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:03.173947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:03.174140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:03.174416 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:03.197900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b5423004-9aac-4d6d-b735-84499651c619 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1671 microversion: 2.1 time: 0.261831 Sep 02 21:35:03.197900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 533/1023] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:02 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1671 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:03.206198 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:03.211322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for user e9450f3f7527406ab70fcf0b64cab787 and project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:03.271752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:35:03.275051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='966c1f09-3397-45be-b011-78d886172931',volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:35:04.163411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0179fe1f-47cb-4d0a-8fb9-f914cf487f82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.673855 Sep 02 21:35:04.164905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 491/1024] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:35:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:35:04.176683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b59d2eb1-65c6-480d-9ec2-e1cdd0754c53 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:04.177299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b59d2eb1-65c6-480d-9ec2-e1cdd0754c53 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:04.229235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:04.246821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:04.249113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b59d2eb1-65c6-480d-9ec2-e1cdd0754c53 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:04.258739 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b59d2eb1-65c6-480d-9ec2-e1cdd0754c53 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1094 microversion: 2.1 time: 0.085884 Sep 02 21:35:04.259368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 534/1025] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:04 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:04.264229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:04.264980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:04.265863 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:04.268856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:04.268856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:04.268856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:04.436360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:04.444376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1bcf29ac-4721-4f7e-b974-4791b2f151c9 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1671 microversion: 2.1 time: 0.223599 Sep 02 21:35:04.445148 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 492/1026] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:04 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:05.144387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c014649-1c60-4f3c-abda-8dac1ecb03fc"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:05.146935 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:05.154597 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.155088 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.155530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.156233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.156684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.157105 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.282046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:05.282688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:05.289561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.290096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.290549 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.291252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.291715 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.292147 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.357592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:05.367033 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3025eda3-48ee-4e00-bfc6-a85336aadc61 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1144 microversion: 2.1 time: 0.088197 Sep 02 21:35:05.368293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 493/1027] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:05 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:05.468853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:05.469482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:05.476334 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.476827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.477273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.478005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:05.478476 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:05.478909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:05.637442 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:05.645341 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c5613389-727c-4526-8ae6-7a3d15880bb0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1671 microversion: 2.1 time: 0.180390 Sep 02 21:35:05.645993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 494/1028] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:05 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:06.165541 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d0b703e6-f43e-4ea3-8de1-66c643d29332 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024868 Sep 02 21:35:06.172288 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 535/1029] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:35:05 2022] POST /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:06.392130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:06.393233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:06.401832 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:06.402326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:06.402820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:06.407478 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:06.408474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:06.409133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:06.485677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:06.497475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a74294d8-5a55-45da-964b-33df62b199f7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1192 microversion: 2.1 time: 0.110353 Sep 02 21:35:06.498802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 495/1030] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:06 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:06.672123 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:06.672772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:06.679405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:06.679903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:06.681778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:06.682530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:06.683155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:06.683440 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:06.766789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:06.776728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5138ddbb-434a-4645-84b2-fb0674224b16 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1605 microversion: 2.1 time: 0.109331 Sep 02 21:35:06.778282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 536/1031] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:06 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:06.793766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993dfc89-c315-4607-a0d2-1e2733afa8b5", "name": "network-vif-deleted", "tag": "3ad91c75-b560-4706-b245-5afdbadb2696"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:06.806252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:06.806252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:06.806252 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:06.816626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] Creating event network-vif-deleted:3ad91c75-b560-4706-b245-5afdbadb2696 for instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 on hv-cinder-85221 Sep 02 21:35:06.822017 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-e24521b1-198c-443d-af7c-887484349df0 req-516620ad-9dc9-490b-8be4-0475be3d6a0e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Sep 02 21:35:06.822631 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 496/1032] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:07.547615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:07.549591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:07.562212 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:07.563427 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:07.564594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:07.566166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:07.567202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:07.567863 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:07.658134 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:07.667868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2be27ef0-4a1b-4243-a043-5af7a9057d56 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1210 microversion: 2.1 time: 0.130028 Sep 02 21:35:07.668899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 537/1033] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:07 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:07.803753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:07.804500 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:07.811341 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:07.812037 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:07.812580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:07.813393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:07.813900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:07.814380 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:07.854830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:07.855509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:07.856191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:07.856552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lazy-loading 'fault' on Instance uuid 993dfc89-c315-4607-a0d2-1e2733afa8b5 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:07.914241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca47c37cd2d4999afa598cac6daa2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4957407e948fc909aadade7d19719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:07.926962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ff64ee47-edad-4eac-a107-2e8ef5beb4a0 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 200 len: 1327 microversion: 2.1 time: 0.127793 Sep 02 21:35:07.928006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 497/1034] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:07 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:08.698366 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:08.698940 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:08.705399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:08.705918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:08.706360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:08.707060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:08.707517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:08.707947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:08.854213 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:08.863743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ddedbd22-15ea-4592-bcf0-580922273bee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.167998 Sep 02 21:35:08.863743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 538/1035] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:08 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:08.955514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:08.956067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:08.962664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:08.963157 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:08.963605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:08.964303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:08.964772 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:08.965201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:08.980358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 HTTP/1.1 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:08.982085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:08.984402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '993dfc89-c315-4607-a0d2-1e2733afa8b5'} Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:08.985802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:08.988073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:08.990066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:08.990066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb6a926d-74cf-4fa6-b00f-0c65e3858e47 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 404 len: 111 microversion: 2.1 time: 0.033266 Sep 02 21:35:08.990066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 498/1036] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:08 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:08.992817 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6bd71690-db7c-4c61-8cde-975a8b2c2a1a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '.version_select at 0x7faac41e1280>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:09.092195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71a5df2-5585-4e89-9529-053e26493377", "tag": "ccaa401d-f126-4d70-8191-e1211a3942ec"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:09.103035 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.103616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.104043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.116377 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6bd71690-db7c-4c61-8cde-975a8b2c2a1a tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516523201" status: 202 len: 0 microversion: 2.1 time: 0.127556 Sep 02 21:35:09.117289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] Creating event network-changed:ccaa401d-f126-4d70-8191-e1211a3942ec for instance e71a5df2-5585-4e89-9529-053e26493377 on hv-cinder-85221 Sep 02 21:35:09.121614 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 539/1037] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516523201 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:09.123647 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-1382ceb1-e340-41bc-9b63-092e871df265 req-ed17fe51-4c93-4f71-815d-e9668c0fb720 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035827 Sep 02 21:35:09.124100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 499/1038] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:09.886758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:09.887465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:09.893745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.894248 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.896980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.896980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.896980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.896980 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:10.043525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:10.051711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c5189edc-f4f5-4421-b27d-d27e7784df5e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.169649 Sep 02 21:35:10.052309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 540/1039] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:09 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:11.075469 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:11.076188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:11.083220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:11.088304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:11.088304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:11.088304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:11.088304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:11.088712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:11.234754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:11.242732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a447e27c-b5d3-4009-9e6d-8691e9334ebd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.171703 Sep 02 21:35:11.243301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 500/1040] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:11 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:12.268143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:12.268803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:12.275823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.281934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.281934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.281934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.281934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.282307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.282307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:12.427412 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:12.435848 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0f1f3613-0359-4fbf-9f0c-b8562dc8dd38 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.171613 Sep 02 21:35:12.436423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 541/1041] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:12 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:12.882459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:12.883267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:12.890332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.890809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.891255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.891968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.892435 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.892872 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.897062 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:12.909439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 HTTP/1.1 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:12.911145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.912810 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '993dfc89-c315-4607-a0d2-1e2733afa8b5'} Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:12.913798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.915927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.917408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:12.917408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2a9a1e6e-8f47-456d-a5e6-d9f28e308217 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 404 len: 111 microversion: 2.1 time: 0.034116 Sep 02 21:35:12.917408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 501/1042] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:12 2022] DELETE /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:12.922057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:12.922674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: 993dfc89-c315-4607-a0d2-1e2733afa8b5] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:12.929023 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.929535 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.930012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.930723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.931179 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.931796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.945630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 HTTP/1.1 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:12.947350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.948926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '993dfc89-c315-4607-a0d2-1e2733afa8b5'} Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:12.949797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. Sep 02 21:35:12.951005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:12.952162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance 993dfc89-c315-4607-a0d2-1e2733afa8b5 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:12.952162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e3f5d29a-0d7f-4b8e-826d-5e7c7fed9b38 tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5" status: 404 len: 111 microversion: 2.1 time: 0.030911 Sep 02 21:35:12.952162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 542/1043] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:12 2022] GET /compute/v2.1/servers/993dfc89-c315-4607-a0d2-1e2733afa8b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:35:13.459163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:13.459737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:13.461971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:13.462660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:13.468014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:13.468501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:13.468939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:13.469664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:13.470150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:13.470580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:13.607494 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:13.620162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ab072a41-fade-46dc-898b-e9bc8a9c0bae tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.165251 Sep 02 21:35:13.620765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 502/1044] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:13 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:14.275293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:14.279491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:14.279995 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:14.286176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.286666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.287112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.287838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.288299 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.288737 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.306253 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa HTTP/1.1 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:14.307936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.309516 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'ff2f4ef0-ee14-44b1-aced-1da687734ffa'} Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:14.310464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.311941 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.313445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:14.313445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f420969f-aa5d-4b37-b7e0-0c5b1ccdbfbb tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 404 len: 111 microversion: 2.1 time: 0.036239 Sep 02 21:35:14.313445 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 543/1045] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:14 2022] DELETE /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:14.318610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:14.319235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] [instance: ff2f4ef0-ee14-44b1-aced-1da687734ffa] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:14.326099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.326589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.327044 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.327744 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.328209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.328678 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] HTTP exception thrown: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Request method failure captured: Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa HTTP/1.1 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSRSQJYCbFKCwsXmxy7GU0VaRyCVF1ku3Et0t7MSz0EcQxXEKxjME-JjgLKVY10HnVctZAbXuT5W-qKYa0dgv4iIMtkHB1bHMQ9gZCPD6-Fq5IhGIxPReSKT1jqbF0JJlV2qjiXEY3QK39IYPdEQWbcFRRyUTM1ob3is5Yy8Z2GAEY Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:14.356085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d1e4957407e948fc909aadade7d19719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d1e4957407e948fc909aadade7d19719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d1e4957407e948fc909aadade7d19719", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d1e4957407e948fc909aadade7d19719 Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1466498707 Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 2ca47c37cd2d4999afa598cac6daa2e7 Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-1466498707-project Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.357836 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ff2f4ef0-ee14-44b1-aced-1da687734ffa'} Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:14.358736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. Sep 02 21:35:14.360184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.362003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] Returning 404 to user: Instance ff2f4ef0-ee14-44b1-aced-1da687734ffa could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:14.362003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-03cd3ca1-0e6d-421a-9438-0b61edb1533b tempest-AttachVolumeTestJSON-1466498707 tempest-AttachVolumeTestJSON-1466498707-project] 10.222.0.99 "GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa" status: 404 len: 111 microversion: 2.1 time: 0.031851 Sep 02 21:35:14.362003 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 503/1046] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:14 2022] GET /compute/v2.1/servers/ff2f4ef0-ee14-44b1-aced-1da687734ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:14.643977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:14.644588 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:14.651612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.652100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.653125 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.653241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.653680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.654137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.793469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:14.802686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f390fba3-37f4-4c93-ad73-6622e1e48b13 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.162358 Sep 02 21:35:14.803507 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 544/1047] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:14 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:15.827584 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:15.828322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:15.836155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:15.836819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:15.837338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:15.838158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:15.838739 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:15.839386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:15.945152 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c014649-1c60-4f3c-abda-8dac1ecb03fc"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:15.948563 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:15.962095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:15.966394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:15.967069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:15.968006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:15.969973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:15.970584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:15.991164 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:16.006136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-88f85cd6-1fca-4473-829d-43f9ee4943c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1277 microversion: 2.1 time: 0.184209 Sep 02 21:35:16.011556 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 504/1048] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:15 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:16.082967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: POST /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments HTTP/1.1 Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 74 Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:16.084651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {"volumeAttachment": {"volumeId": "8c014649-1c60-4f3c-abda-8dac1ecb03fc"}} Sep 02 21:35:16.087012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'server_id': '9f8ac4fe-677d-40b0-a232-2bac3efd019d', 'body': {'volumeAttachment': {'volumeId': '8c014649-1c60-4f3c-abda-8dac1ecb03fc'}}} Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:16.087930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:16.089325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 400 to user: Invalid volume: volume 8c014649-1c60-4f3c-abda-8dac1ecb03fc is already attached to instances: 9f8ac4fe-677d-40b0-a232-2bac3efd019d {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca4562bd-660b-4b4d-9ba9-3ba78e21452c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145456 Sep 02 21:35:16.091280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 545/1049] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:35:15 2022] POST /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:35:16.175463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:16.175969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:16.182719 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:16.183220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:16.183667 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:16.186369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:16.186369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:16.186369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:16.300979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'services' on Instance uuid 9f8ac4fe-677d-40b0-a232-2bac3efd019d {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:16.604799 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8fc5bb99-451a-4170-bcf7-31a8d900d26d tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments/8c014649-1c60-4f3c-abda-8dac1ecb03fc" status: 202 len: 0 microversion: 2.1 time: 0.437611 Sep 02 21:35:16.608387 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 505/1050] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:35:16 2022] DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments/8c014649-1c60-4f3c-abda-8dac1ecb03fc => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:16.614220 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:16.616398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:16.624244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:16.624732 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:16.625164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:16.625954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:16.626408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:16.626829 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:16.657336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a7b9fc8b-0940-4201-8af2-a4629d4f85c4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047099 Sep 02 21:35:16.658190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 546/1051] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:16 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:17.036459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:17.037262 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:17.043862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:17.044369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:17.044821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:17.045535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:17.046029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:17.046468 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:17.336692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:17.345132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-072f1bc1-8ba7-49a1-a262-21dbdca027c0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.313562 Sep 02 21:35:17.346027 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 506/1052] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:17 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:17.671455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:17.673917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:17.681443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:17.682358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:17.682830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:17.683560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:17.684757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:17.685246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:17.718584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-07063ef7-74ae-407c-9d20-011dea88be5c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051189 Sep 02 21:35:17.723945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 547/1053] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:17 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:18.369909 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:18.378569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:18.386283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.387213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.387913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.388961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.389875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.390617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.599206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:18.608290 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c26202e-83b8-4862-9cf3-52edcd8b7550 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.243538 Sep 02 21:35:18.609207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 507/1054] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:18 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:18.732200 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:18.734477 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:18.741000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.742663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.743308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.744192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.744668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.745113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.777227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2c468640-bf47-40f5-a995-34eda3061666 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049011 Sep 02 21:35:18.777950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 548/1055] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:18 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:19.637826 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:19.638462 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:19.647711 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.648251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.649353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.650112 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.650585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.651025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.790732 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:19.792965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:19.800749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.801248 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.801690 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.803859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.804405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.806048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.824408 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:19.832405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-332be832-6a53-4b01-a6f0-082fd1f3900d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.204666 Sep 02 21:35:19.832986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 508/1056] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:19 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:19.840830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b145e02f-0541-4b9f-91e3-9cbe378750fe tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054636 Sep 02 21:35:19.841419 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 549/1057] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:19 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 21:35:19.908391 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:19.908892 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:19.915877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.916362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.916791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.917480 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.917963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.918388 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.950415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:20.308349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-00c39e57-931c-4316-9773-47f5d36e96c6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 204 len: 0 microversion: 2.1 time: 0.403676 Sep 02 21:35:20.309096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 509/1058] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:19 2022] DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:35:20.319173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:20.319573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:20.326406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.326889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.327323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:20.329674 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.330771 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.331214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:20.476282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:20.484449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f94cd23-af55-425c-b130-7bc1604e3886 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1678 microversion: 2.1 time: 0.170487 Sep 02 21:35:20.485021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 550/1059] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:20 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:20.856588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:20.857294 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:20.860798 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:20.864355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.864843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.865279 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:20.866020 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.866475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.867552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.024726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:21.032454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b4b79124-d3bb-4730-aaba-aa08a6bdafc1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.180091 Sep 02 21:35:21.033289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 510/1060] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:20 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:21.508812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:21.509407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:21.516881 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:21.517406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:21.517874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.523264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:21.523264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:21.523264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.664888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:21.672979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bf91a8d2-dc8c-42d9-8877-78e2d2692df0 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1678 microversion: 2.1 time: 0.168182 Sep 02 21:35:21.675774 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 551/1061] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:21 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:22.055679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:22.056301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:22.062847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.063345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.063793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.064499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.064967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.065405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.275311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:22.283832 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dd644b8a-9d83-459a-a108-4fc7edde0ed5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.232691 Sep 02 21:35:22.284425 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 511/1062] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:22 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:22.394913 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1864237441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-516683868", "security_groups": [{"name": "tempest-secgroup-smoke-604946812"}], "networks": [{"uuid": "f3040f15-6aa8-436a-abcb-bd0226b692c8"}], "block_device_mapping_v2": [{"uuid": "1a2cc824-df67-41aa-afe5-f18b34785017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:22.513171 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] validate_networks() for [('f3040f15-6aa8-436a-abcb-bd0226b692c8', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:35:22.704807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:22.705504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:22.718133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.718639 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.721818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.721818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.721818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.721818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.986307 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:22.995819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ff5c3acd-4a3c-4287-8056-b88fb0d8aae7 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1678 microversion: 2.1 time: 0.303116 Sep 02 21:35:22.997099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 512/1063] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:22 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:23.102635 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:35:23.103466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:35:23.103948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:35:23.104368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:35:23.104777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:35:23.114894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.115683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.116290 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.118510 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.119149 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.119744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.138337 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Getting quotas for project ed9e8bc2976f4e2a8f439f89440bdaa3. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:23.143414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Getting quotas for user 7984fc2a59704c10905656ae32dc68af and project ed9e8bc2976f4e2a8f439f89440bdaa3. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:23.202771 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:35:23.204928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a2cc824-df67-41aa-afe5-f18b34785017',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:35:23.307842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:23.308499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:23.315165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.315662 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.316113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.316829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.317299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.317759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.467654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:23.477643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b27f6d81-dd34-40bd-9295-0b03aaf5d960 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.173920 Sep 02 21:35:23.478472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 513/1064] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:23 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:23.673036 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8ac4fe-677d-40b0-a232-2bac3efd019d", "name": "network-vif-deleted", "tag": "58fbdf95-2275-437c-aa59-cac7abcb6417"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:23.682874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.683402 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.683870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.698282 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] Creating event network-vif-deleted:58fbdf95-2275-437c-aa59-cac7abcb6417 for instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d on hv-cinder-85221 Sep 02 21:35:23.703342 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-695b99a7-8490-4c09-b060-2634181c651c req-ee9bcb91-8439-47b0-9ccc-ca6c5cb3ad65 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034087 Sep 02 21:35:23.703895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 514/1065] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:23.795689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e38971c1-1597-4785-8070-fcefcaff2414 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.404727 Sep 02 21:35:23.797775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 552/1066] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:35:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:35:23.814115 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-417171b5-d45f-441a-9b05-486945a44aa7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:23.815491 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-417171b5-d45f-441a-9b05-486945a44aa7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:23.910886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-417171b5-d45f-441a-9b05-486945a44aa7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:23.923704 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-417171b5-d45f-441a-9b05-486945a44aa7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1088 microversion: 2.1 time: 0.115730 Sep 02 21:35:23.926297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 515/1067] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:23 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1088 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:24.020341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:24.021175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:24.029160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.030004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.030654 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.031511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.032150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.032736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.128457 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:24.148714 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a7bf267b-c629-490b-9cda-0733ec405ad4 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1611 microversion: 2.1 time: 0.131533 Sep 02 21:35:24.149306 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 553/1068] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:24 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1611 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:24.501467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:24.502117 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:24.510543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.512326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.512326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.512326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.512764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.512990 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.667451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:24.676363 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7344ff3e-63e1-420c-9987-bf36e457cb1c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.178700 Sep 02 21:35:24.676956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 516/1069] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:24 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:24.948110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e7af8a8b-95fd-4fc8-8c44-ca5283a49348 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:24.948748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e7af8a8b-95fd-4fc8-8c44-ca5283a49348 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:25.011013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e7af8a8b-95fd-4fc8-8c44-ca5283a49348 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:25.024208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e7af8a8b-95fd-4fc8-8c44-ca5283a49348 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1088 microversion: 2.1 time: 0.080468 Sep 02 21:35:25.025182 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 554/1070] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:24 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:25.172765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:25.173386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:25.179999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:25.180715 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:25.181158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:25.181895 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:25.182353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:25.182788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:25.214643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:25.214643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:25.215126 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:25.215592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'fault' on Instance uuid 9f8ac4fe-677d-40b0-a232-2bac3efd019d {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:25.264223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:25.272477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a81f4b52-b29e-4d1c-ba09-d4c95e279c46 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 200 len: 1330 microversion: 2.1 time: 0.103663 Sep 02 21:35:25.273088 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 517/1071] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:25 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:25.706484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:25.707349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:25.715000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:25.715786 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:25.716776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:25.717453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:25.718519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:25.720745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:25.996233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:26.004312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e3bfca0-654a-410f-b867-c6844fb28db0 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.303184 Sep 02 21:35:26.004883 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 555/1072] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:25 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:26.047276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:26.047886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:26.054552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.055254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.055801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.056624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.057246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.057811 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.062362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:26.148595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:26.156340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-aa5909bd-9625-4283-93f0-637cf8964639 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1130 microversion: 2.1 time: 0.112920 Sep 02 21:35:26.156914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 518/1073] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:26 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1130 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:26.296423 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:26.297331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:26.305570 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.306268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.307011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.307971 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.308599 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.309192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.325975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d HTTP/1.1 Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:26.327703 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:35:26.329100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '9f8ac4fe-677d-40b0-a232-2bac3efd019d'} Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:26.333692 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:35:26.335076 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:26.336341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:26.336341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8804c015-9545-471b-b1f1-fe356c59398c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 404 len: 111 microversion: 2.1 time: 0.037216 Sep 02 21:35:26.336341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 556/1074] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:26 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:26.341978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f8fc2436-2fcb-4af0-9676-6dc1f1eb0cd6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '.version_select at 0x7faac09f1160>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:26.440291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f8fc2436-2fcb-4af0-9676-6dc1f1eb0cd6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517719187" status: 202 len: 0 microversion: 2.1 time: 0.102095 Sep 02 21:35:26.441208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 519/1075] 10.222.0.99 () {58 vars in 1218 bytes} [Fri Sep 2 21:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517719187 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:27.029064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:27.029758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:27.036986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:27.037821 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:27.038512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:27.040313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:27.040803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:27.041447 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:27.180515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:27.181136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:27.196618 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:27.197873 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:27.198580 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:27.200398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:27.201437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:27.202483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:27.279893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:27.290979 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-55ada4c2-41b6-447a-adc1-67cb11e166d7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.265908 Sep 02 21:35:27.291966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 557/1076] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:27 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:27.309748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:27.318771 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6921892d-bbb0-467e-860a-16e77cc04fe5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1194 microversion: 2.1 time: 0.142879 Sep 02 21:35:27.320855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 520/1077] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:27 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:27.552920 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-12325b5c-fa81-452b-a656-30344909d868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: .version_select at 0x7faac42843a0>, body: {"keypair": {"name": "tempest-keypair-1615418862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbIfqDczXuV9DqsqYdU7i/LjUEhnarS7e/P6pJWsKAjnC7cLWyt3H4HcRzZ7RJr2uL670pnHF0XaGj01RYh06P75MsiflAUUfmkNA8ahYpY4/fqcBbKFeh/hn4RDQsiaQ=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:27.589345 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-12325b5c-fa81-452b-a656-30344909d868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:27.593972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-12325b5c-fa81-452b-a656-30344909d868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:27.596401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:27.761258 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-12325b5c-fa81-452b-a656-30344909d868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.213666 Sep 02 21:35:27.762342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 558/1078] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:35:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:28.315756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:28.316525 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:28.327968 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.328815 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.329323 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:28.330232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.330862 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.331286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:28.346627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:28.347548 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:28.355061 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.355567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.356016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:28.358646 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.359360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.359814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:28.625999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:28.635463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1f11b211-8575-4182-a701-4306a8ddf67b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.324372 Sep 02 21:35:28.636428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 521/1079] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:28 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:28.674142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:28.683086 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-699c50bf-ba50-44a9-ae2b-3e6c8c8b5cfe tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1271 microversion: 2.1 time: 0.343081 Sep 02 21:35:28.684961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 559/1080] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:28 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:29.541229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:29.553634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:29.554280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:29.555097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:29.572465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] Creating event network-changed:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:35:29.578136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0c5f9fa2-f90e-4f4f-868b-e038954694c0 req-81819735-cc07-449a-9f9f-d8007d5dd966 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318440 Sep 02 21:35:29.579247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 522/1081] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:35:29.660078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:29.666936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:29.668490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:29.668988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:29.669432 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:29.670168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:29.670820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:29.671255 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:29.709140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:29.710356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:29.717381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:29.722749 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:29.723339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:29.724421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:29.724960 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:29.725490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:30.031592 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:30.095273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-95597fe4-9f26-4614-816f-ad6a429ddbd6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.335940 Sep 02 21:35:30.095399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:30.095515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 523/1082] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:29 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:30.095618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9dcce218-e7f2-45c0-8030-a05a59a71cc5 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.394485 Sep 02 21:35:30.095618 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 560/1083] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:29 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:30.095792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71a5df2-5585-4e89-9529-053e26493377", "name": "network-vif-plugged", "status": "completed", "tag": "ccaa401d-f126-4d70-8191-e1211a3942ec"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:30.095792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:30.095792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:30.095792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:30.101025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] Creating event network-vif-plugged:ccaa401d-f126-4d70-8191-e1211a3942ec for instance e71a5df2-5585-4e89-9529-053e26493377 on hv-cinder-85221 Sep 02 21:35:30.106513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-bb5142b0-1ed2-411b-8290-cb254fb134f5 req-e5ef174d-de8f-4bfe-9cbc-ba717e246c00 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Sep 02 21:35:30.107191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 524/1084] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:31.064900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:31.065677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:31.073349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:31.073878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:31.074532 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:31.075439 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:31.075909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:31.076353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:31.079884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:31.081883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:31.088542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:31.091675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:31.091675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:31.091675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:31.091675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:31.092360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:31.296545 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:31.300207 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d0ff00e7-b2fa-4ab1-8408-752868f98eab tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.239408 Sep 02 21:35:31.300808 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 561/1085] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:31 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:31.301879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:31.306712 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-84267535", "imageRef": "3afa5381-ed53-499f-bb0f-7ba43c54c286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "315bf927-f303-4323-bf17-32171d1e63b8"}], "security_groups": [{"name": "tempest-securitygroup--2080072078"}], "key_name": "tempest-keypair-1615418862", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:31.311475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-029427a2-9ebd-47d7-8ba7-9e8e3e3c98ee tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.238993 Sep 02 21:35:31.312184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 525/1086] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:31 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:31.436549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] validate_networks() for [('315bf927-f303-4323-bf17-32171d1e63b8', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:35:31.998554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:35:31.998554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:35:31.998554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:35:31.998554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:35:31.998554 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:35:32.007111 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.008598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.009216 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.010281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.010750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.011529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.034643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:32.039583 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Getting quotas for user 7d2ee46e8302468bb90ee913eeeba4af and project de8efd74da71400a83f05127451c13fd. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:32.051165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:35:32.053322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3afa5381-ed53-499f-bb0f-7ba43c54c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:35:32.219269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d34fa246-2a1e-40cd-9a2f-575ae372373c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917424 Sep 02 21:35:32.226738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 562/1087] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:35:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:35:32.232409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ef659c08-0dab-4ec0-8db8-65a97b36537b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:32.233101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ef659c08-0dab-4ec0-8db8-65a97b36537b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:32.291229 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ef659c08-0dab-4ec0-8db8-65a97b36537b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:32.301603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ef659c08-0dab-4ec0-8db8-65a97b36537b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1240 microversion: 2.1 time: 0.073201 Sep 02 21:35:32.302799 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 526/1088] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:32 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:32.324585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:32.325204 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:32.334820 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.335599 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.336829 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.337937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.338790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.339450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.340828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:32.341589 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:32.345281 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:32.350883 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.351591 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.352270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.353058 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:32.353763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:32.354275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:32.569572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:32.577830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:32.592363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ce848182-3700-4247-b63e-205fb5012db0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.272202 Sep 02 21:35:32.593091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 563/1089] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:32 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:32.597332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5da7e86a-af72-4d9d-9e11-12acb0eeba82 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1265 microversion: 2.1 time: 0.262555 Sep 02 21:35:32.597915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 527/1090] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:32 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:33.325700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3ea2c9b7-83da-49f1-9949-a39fc10f5acb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:33.326352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3ea2c9b7-83da-49f1-9949-a39fc10f5acb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:33.381569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3ea2c9b7-83da-49f1-9949-a39fc10f5acb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:33.389453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3ea2c9b7-83da-49f1-9949-a39fc10f5acb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1240 microversion: 2.1 time: 0.067779 Sep 02 21:35:33.390064 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 564/1091] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:33 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:33.618830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:33.619674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:33.623236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:33.623851 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:33.626031 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.626528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.626979 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:33.627684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.628151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.628588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:33.630100 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.630590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.631035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:33.631736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.632273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.633442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:33.835547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:33.840794 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:33.844047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-583b6044-0cab-4c55-8049-2436c0fd28a3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.229849 Sep 02 21:35:33.844646 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 528/1092] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:33 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:33.848741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-75318d40-bf46-4427-9f66-7f87b78b3c88 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1451 microversion: 2.1 time: 0.229348 Sep 02 21:35:33.849307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 565/1093] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:33 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1451 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:33.871991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:33.872614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:33.879201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.879532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.880077 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:33.880665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:33.881127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:33.881562 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:34.039712 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:34.047594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a64284f-e9e4-419c-abb7-d628abad2edf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1451 microversion: 2.1 time: 0.179521 Sep 02 21:35:34.048329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 529/1094] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:33 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:34.413140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:34.414955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:34.428042 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:34.428796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:34.429286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:34.430499 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:34.430645 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:34.431329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:34.513163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:34.521549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d23e6e01-f467-4e52-801b-44fd56e03386 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1236 microversion: 2.1 time: 0.112179 Sep 02 21:35:34.523297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 566/1095] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:34 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:34.868676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:34.869812 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:34.880227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:34.883095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:34.883637 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:34.886011 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:34.886847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:34.887193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:35.045523 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:35.053554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-86704528-71ac-47e0-a1ff-bde668fea9d3 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.190360 Sep 02 21:35:35.054144 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 530/1096] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:34 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:35.549013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:35.550004 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:35.560652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:35.561380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:35.562063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:35.563134 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:35.564066 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:35.564710 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:35.653831 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:35.662397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e14ef013-e542-47ed-9e8a-db92bf96af76 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1300 microversion: 2.1 time: 0.119433 Sep 02 21:35:35.662992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 567/1097] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:35 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:36.079928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:36.080747 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:36.088972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:36.089564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:36.090113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:36.091121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:36.091656 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:36.092384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:36.247255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:36.256908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3c6f7c34-b038-4741-b18e-c53ea02fa3a5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.183551 Sep 02 21:35:36.258694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 531/1098] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:36 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:36.690840 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:36.691455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:36.699939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:36.700102 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:36.700550 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:36.701364 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:36.701912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:36.702405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:36.773334 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:36.781704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fc18799f-eb14-4f2e-a764-d47711cd0ba1 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1298 microversion: 2.1 time: 0.094829 Sep 02 21:35:36.782529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 568/1099] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:36 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:36.987237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71a5df2-5585-4e89-9529-053e26493377", "tag": "ccaa401d-f126-4d70-8191-e1211a3942ec"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:37.000446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:37.001188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:37.001917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:37.016241 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] Creating event network-changed:ccaa401d-f126-4d70-8191-e1211a3942ec for instance e71a5df2-5585-4e89-9529-053e26493377 on hv-cinder-85221 Sep 02 21:35:37.021594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-7590e853-812c-4a06-ae74-ebad8cba4552 req-ead55d35-ca96-4328-bcaf-37dea4e197fb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038526 Sep 02 21:35:37.025148 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 532/1100] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:37.289168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:37.290143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:37.297332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:37.298270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:37.298913 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:37.299826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:37.300285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:37.300899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:37.459727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:37.468326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2365de6f-ce8c-4590-ab56-ae1b0f77ea35 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.183026 Sep 02 21:35:37.469016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 569/1101] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:37 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:37.810130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:37.811679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:37.829460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:37.830364 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:37.831034 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:37.832183 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:37.832881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:37.833502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.067769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:38.082563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7b053f8d-0c98-4ec1-b50c-53f79eed1309 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.278311 Sep 02 21:35:38.083851 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 533/1102] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:37 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:38.498778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:38.499389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:38.506052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.506533 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.507842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.508223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.508678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.509103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.671190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:38.679071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fb4f127b-e8e9-43e9-8d6a-0388932fd07f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.184341 Sep 02 21:35:38.679652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 570/1103] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:38 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:39.049788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c80b55-4fc6-479e-92f0-990ccf8156e6", "tag": "47d37144-8305-4222-a176-d86a434a6a00"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:39.060309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.060842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.061280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.073975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] Creating event network-changed:47d37144-8305-4222-a176-d86a434a6a00 for instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 on hv-cinder-85221 Sep 02 21:35:39.080071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c4d8bcd6-cee7-462e-959b-8b59609a9916 req-927b73d1-4fbe-40c4-a0d6-0389cd034adc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Sep 02 21:35:39.080071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 534/1104] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:39.108305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:39.109336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:39.117375 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.118084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.118652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.119240 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.119797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.120233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.260349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:39.268525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cb3e40bb-631c-4618-adee-92c02f66972a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.164937 Sep 02 21:35:39.271223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 571/1105] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:39 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:39.701758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:39.702601 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:39.708845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.709330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.709863 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.711102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.711698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.712155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.882329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:39.891641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be9f6177-f33a-4d4a-8368-bedf15fc8d95 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.194059 Sep 02 21:35:39.892419 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 535/1106] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:39 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:40.292367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:40.293021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:40.299540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.300002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.300434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:40.301128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.301580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.302078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:40.437548 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:40.446742 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f2b51f9-9f31-4204-bd48-c2a4a9153f9b tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.158540 Sep 02 21:35:40.447339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 572/1107] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:40 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:40.919150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:40.919702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:40.926225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.926720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.927190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:40.927874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.928339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.928772 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.067587 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:41.075511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b12a995-9db2-47af-af93-82d476a56dee tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.160302 Sep 02 21:35:41.076092 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 536/1108] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:40 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:41.469587 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:41.470497 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:41.477770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.478268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.478721 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.479436 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.479897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.480329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.616938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:41.625407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8fb621e8-0fc7-4b28-b326-bcceab649974 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.159582 Sep 02 21:35:41.626020 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 573/1109] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:41 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:42.073206 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "name": "network-vif-plugged", "status": "completed", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:42.083568 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.084059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.084497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.096769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] Creating event network-vif-plugged:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:35:42.099397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:42.099691 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:42.102522 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-026f4003-ed30-42f9-bd42-369647e11ed2 req-4445d5ee-b96f-45d9-ac48-c46481476469 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Sep 02 21:35:42.103142 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 537/1110] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:42.105681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:42.107662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.108075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.108511 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.109214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.109670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.110295 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.247403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:42.255557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0952c2c8-e4fa-4a15-b254-181c6178d99b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.160455 Sep 02 21:35:42.256319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 574/1111] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:42 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:42.647165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:42.652284 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:42.653066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:42.659916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.660409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.660856 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.661559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.662050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.662489 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.801573 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:42.812374 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7d11afd4-b6ea-4761-a17a-0b1d78a4016a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.165998 Sep 02 21:35:42.813182 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 538/1112] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:42 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:43.280776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:43.281354 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:43.288736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.289294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.289753 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:43.290513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.290970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.291396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:43.386227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=20 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:43.430515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:43.438136 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3f884408-271b-4e94-81e0-9e008655e306 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1259 microversion: 2.1 time: 0.161321 Sep 02 21:35:43.438716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 575/1113] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:43 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:43.835575 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:43.836246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:43.843415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.844184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.844356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:43.845046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.845513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.845970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:43.990311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:44.000575 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-80c623e2-c048-46da-a878-3a8f9f14b013 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.168414 Sep 02 21:35:44.008957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 539/1114] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:43 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:44.461469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:44.462116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:44.468872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:44.469359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:44.469826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.470661 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:44.471141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:44.471562 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.649139 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:44.661945 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-645b6d7a-9fc7-4b43-a44d-717064196310 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1443 microversion: 2.1 time: 0.203639 Sep 02 21:35:44.663636 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 576/1115] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:44 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1443 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:44.688625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:44.689622 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:44.696197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:44.697013 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:44.697517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.698519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:44.699048 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:44.699701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.704270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:44.888708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:44.897427 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-559335e8-077a-4015-a114-867ec5e0c7d6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1443 microversion: 2.1 time: 0.213081 Sep 02 21:35:44.898056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 540/1116] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:44 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:45.023955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:45.024698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:45.030755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:45.031339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:45.031850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:45.032630 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:45.033393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:45.033798 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:45.190633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:45.198968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b33cc392-2332-4bcc-8902-0c93ac5784d6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.178967 Sep 02 21:35:45.201480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 577/1117] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:45 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:46.194777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.205911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:46.208933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.209748 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.211060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.212802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.213480 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.214135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.252738 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9d5227af-1732-4150-b3d5-06e08f3e8065 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062300 Sep 02 21:35:46.253669 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 578/1118] 10.222.0.99 () {60 vars in 1343 bytes} [Fri Sep 2 21:35:46 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:46.271482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.272309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:46.279491 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.280106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.280687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.281272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.281815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.282246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.331822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c80b55-4fc6-479e-92f0-990ccf8156e6", "name": "network-vif-plugged", "status": "completed", "tag": "47d37144-8305-4222-a176-d86a434a6a00"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:46.342959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.343445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.343887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.356976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] Creating event network-vif-plugged:47d37144-8305-4222-a176-d86a434a6a00 for instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 on hv-cinder-85221 Sep 02 21:35:46.362067 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-62d4c786-7117-4476-99ac-72d8aefdd6f3 req-ce065cfa-8e67-4c51-8000-6e52f1107b91 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315522 Sep 02 21:35:46.362683 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 541/1119] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:46.368383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.371610 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:46.375818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.376329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.376758 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.377475 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.378025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.378459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.410378 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:46.516199 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:46.525219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-59d645cd-ed4e-46bd-8e43-75527d6986c2 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.257774 Sep 02 21:35:46.537942 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 579/1120] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:46 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:46.952880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-28ecad8d-1620-4045-8a87-124a5b46eb6d tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 204 len: 0 microversion: 2.20 time: 0.588684 Sep 02 21:35:46.953603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 542/1121] 10.222.0.99 () {60 vars in 1280 bytes} [Fri Sep 2 21:35:46 2022] DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:35:46.963544 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.964278 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:46.971740 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.972543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.973248 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.974316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.974989 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.975616 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:47.400638 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:47.404142 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:47.411633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:47.413828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:47.415911 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a54f67bf-8c4d-44a1-82f6-5e97bde55ba3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.456972 Sep 02 21:35:47.417005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 580/1122] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:46 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:35:47.550684 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:47.551420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:47.558506 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:47.558991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:47.559432 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:47.560132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:47.560584 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:47.561008 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:47.780398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:47.789177 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c0fd3d3c-c887-47d0-b5c2-d105a5e5863f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.243082 Sep 02 21:35:47.790844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 543/1123] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:47 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:47.970184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:47.981181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:47.981666 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:47.982128 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:47.995686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] Creating event network-changed:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:35:48.001110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-626f6bdb-39b5-4622-b831-5b98fc209d75 req-9b2f3629-037f-4eb1-b3cb-bd4f88e18fc8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258216 Sep 02 21:35:48.001893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 581/1124] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:35:48.443163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:48.443884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:48.451586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:48.452102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:48.452541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:48.454149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:48.454149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:48.454393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:48.615585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:48.628233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:48.629513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:48.630822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-84be9730-67aa-4ae0-bdff-f1fc1e9ca6cb tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.191774 Sep 02 21:35:48.631381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 544/1125] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:48 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:35:48.816315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:48.817025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:48.825176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:48.826137 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:48.826741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:48.827906 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:48.828728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:48.829332 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:48.994522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:49.011709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dd8d67b3-a12c-4dd6-9717-3148329ecd00 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.199743 Sep 02 21:35:49.012623 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 582/1126] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:48 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:49.660893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:49.662803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:49.671328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:49.671976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:49.672417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:49.673134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:49.673668 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:49.674140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:49.917076 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:49.926679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:49.928420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:49.931924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9aa4f572-79eb-4540-b0f4-b43d09415394 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1724 microversion: 2.20 time: 0.275078 Sep 02 21:35:49.931924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 545/1127] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:49 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:35:50.038567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:50.039795 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:50.046279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.046777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.047270 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.048095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.048561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.048996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.232426 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:50.240745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1cbddbe2-0e21-4cbc-991e-e06092acb2ed tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1366 microversion: 2.1 time: 0.206097 Sep 02 21:35:50.241549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 583/1128] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:50 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:50.757261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6200de3-d8cd-4c5c-83fd-feb09e67d285", "name": "network-vif-deleted", "tag": "fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:50.774804 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.776822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.777888 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.798841 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] Creating event network-vif-deleted:fa8ff415-f7ed-44b5-b2a5-feaf6fd36b17 for instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 on hv-cinder-85221 Sep 02 21:35:50.807042 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-812cb330-12b2-4052-aa0e-824dce9bfb51 req-2b131a3d-3bd9-48e3-9697-137ed80af3bb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057799 Sep 02 21:35:50.813274 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 546/1129] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:50.960274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:50.962167 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:50.972441 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.973209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.973822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.974909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.975602 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.976077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.048322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:51.058951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:51.061394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:51.063350 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2afb18ec-3321-408a-8822-9857dfad0eea tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1366 microversion: 2.20 time: 0.109010 Sep 02 21:35:51.064259 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 584/1130] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:50 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:35:51.268467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:51.269204 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:51.271325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:51.276789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.277536 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.278357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.279091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.279654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.287262 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.455025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:51.463464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8efa3d68-fd1b-4402-9d4d-605f9d23ee3e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1555 microversion: 2.1 time: 0.200659 Sep 02 21:35:51.464276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 547/1131] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:51 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:51.497938 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:51.498665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:51.505515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.506375 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.507083 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.508574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.509512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.511198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.606777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-18302161-8f18-4cca-815f-7786463982a8 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111579 Sep 02 21:35:51.606777 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 585/1132] 10.222.0.99 () {58 vars in 1275 bytes} [Fri Sep 2 21:35:51 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:52.090237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:52.090876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:52.099583 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.100375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.100820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.102222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.102781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.103250 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.139769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.140343 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.141005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.142046 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lazy-loading 'fault' on Instance uuid a6200de3-d8cd-4c5c-83fd-feb09e67d285 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:52.205477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:52.214674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:52.216130 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4f87633619b42d989942e1d63d30fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e62daccf4b442c8ff2971abbedd74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:52.217339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2bfe6c34-0675-477e-85c2-fde7d376deee tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 200 len: 1371 microversion: 2.20 time: 0.132772 Sep 02 21:35:52.217962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 548/1133] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:52 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:35:52.824767 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c80b55-4fc6-479e-92f0-990ccf8156e6", "tag": "47d37144-8305-4222-a176-d86a434a6a00"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:52.834832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.835681 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.837132 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.855791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] Creating event network-changed:47d37144-8305-4222-a176-d86a434a6a00 for instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 on hv-cinder-85221 Sep 02 21:35:52.863686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-fa3ff660-3f6a-49b8-86cb-41f938f1dbcd req-60472f73-9f85-44ba-bc16-7fbd1af23869 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043506 Sep 02 21:35:52.864743 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 586/1134] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:53.245893 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:53.246657 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:53.256700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:53.256700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:53.256700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:53.256700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:53.257153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:53.257153 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:53.272362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 HTTP/1.1 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:53.274422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:53.276132 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'a6200de3-d8cd-4c5c-83fd-feb09e67d285'} Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:53.277073 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:53.280245 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:53.281445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:53.281445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fa2febbd-926b-4110-8a77-7e900c51ef99 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 404 len: 111 microversion: 2.20 time: 0.039558 Sep 02 21:35:53.287207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 549/1135] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:53 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:35:53.293828 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4425de73-1c31-4c8a-86b4-17b770f8d042 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '.version_select at 0x7faac0de80d0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:53.395768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4425de73-1c31-4c8a-86b4-17b770f8d042 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974378514" status: 204 len: 0 microversion: 2.20 time: 0.106799 Sep 02 21:35:53.405768 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 587/1136] 10.222.0.99 () {60 vars in 1259 bytes} [Fri Sep 2 21:35:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974378514 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:35:56.006869 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:56.007465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:56.014597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.015085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.015528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.016227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.016685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.017112 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.032087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 HTTP/1.1 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:56.033963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.036504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'a6200de3-d8cd-4c5c-83fd-feb09e67d285'} Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:56.037259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.038503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.039918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:56.039918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-afe05097-dfb0-4cc4-ac1e-fab6c88836c3 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 404 len: 111 microversion: 2.20 time: 0.032476 Sep 02 21:35:56.039918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 550/1137] 10.222.0.99 () {60 vars in 1280 bytes} [Fri Sep 2 21:35:56 2022] DELETE /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:35:56.044722 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:56.045449 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: a6200de3-d8cd-4c5c-83fd-feb09e67d285] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:56.051689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.052242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.052688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.053389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.053874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.054321 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.069643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 HTTP/1.1 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:56.072284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.073684 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'a6200de3-d8cd-4c5c-83fd-feb09e67d285'} Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:56.075595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. Sep 02 21:35:56.076960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:56.078582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance a6200de3-d8cd-4c5c-83fd-feb09e67d285 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:56.078582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da1badb5-606f-4f21-a81d-16a6c6b7f628 tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285" status: 404 len: 111 microversion: 2.20 time: 0.033442 Sep 02 21:35:56.078582 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 588/1138] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:56 2022] GET /compute/v2.1/servers/a6200de3-d8cd-4c5c-83fd-feb09e67d285 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:35:57.444719 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:57.445227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:57.451816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.452297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.452733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.453423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.453908 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.454338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.468028 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 HTTP/1.1 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:35:57.469582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.471286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '6083d5d9-fba6-4f90-a05f-5a37896e59a3'} Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:57.472079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.473329 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.474561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:57.474561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-69f03c18-59de-434e-8c83-eeff1a02c25e tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 404 len: 111 microversion: 2.20 time: 0.030453 Sep 02 21:35:57.474561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 551/1139] 10.222.0.99 () {60 vars in 1280 bytes} [Fri Sep 2 21:35:57 2022] DELETE /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:35:57.480400 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:57.481019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] [instance: 6083d5d9-fba6-4f90-a05f-5a37896e59a3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:57.488397 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.488889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.489331 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.490078 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.490540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.490972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.505327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] HTTP exception thrown: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Request method failure captured: Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 HTTP/1.1 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnSSBSXzoCKZhO7g6MWdYcXLgB7SHrEBqfJH6n3fPoEvl0eMgjc8mD7VT_F_JuovPgbq9S29Zrbh7JdxqE27a01HPxTfrC515C9iFB-mIx0FW8470UcXB0XzQOV-T2P2391pr8mC6qhj-B-p5Mwds7qpPNqhhbpyJr-tBkNoC8FBcqc Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:35:57.506975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/94e62daccf4b442c8ff2971abbedd74f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_94e62daccf4b442c8ff2971abbedd74f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 94e62daccf4b442c8ff2971abbedd74f Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710565355 Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: e4f87633619b42d989942e1d63d30fb0 Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710565355-project Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.508827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '6083d5d9-fba6-4f90-a05f-5a37896e59a3'} Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:57.509755 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. Sep 02 21:35:57.511241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:35:57.512612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] Returning 404 to user: Instance 6083d5d9-fba6-4f90-a05f-5a37896e59a3 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:57.512612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bfefb9a4-35b5-4ab0-9a98-7c72f8bc1d4a tempest-AttachVolumeShelveTestJSON-710565355 tempest-AttachVolumeShelveTestJSON-710565355-project] 10.222.0.99 "GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3" status: 404 len: 111 microversion: 2.20 time: 0.032554 Sep 02 21:35:57.512612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 589/1140] 10.222.0.99 () {60 vars in 1277 bytes} [Fri Sep 2 21:35:57 2022] GET /compute/v2.1/servers/6083d5d9-fba6-4f90-a05f-5a37896e59a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:37:42.966403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8501a5c8-dd6b-4b17-960b-99c3e32e2932] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 21:37:42.971535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=11 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:42.971535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:42.971535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 21:37:42.971535 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Fri Sep 2 21:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.99) !!! Sep 02 21:37:42.976991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-32710bdc-efc3-495b-8cf3-e4d360f9ead6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'create', calling method: .version_select at 0x7faac0c523a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-98727817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqD2x91kLO/bsEfcWRjfE0jAZgEVBRSCxjjXNsWvH11jkNJhp9N3WNgrM1cFiRHtMnqH7d4SUVylMOtjbZllypCyVRBIapmifocZ0lADojQRo/5VpOO6a/YwLUik5rNg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:37:42.998413 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-32710bdc-efc3-495b-8cf3-e4d360f9ead6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Getting quotas for project 634952274d2748b988c4610754edc371. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:37:43.002578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-32710bdc-efc3-495b-8cf3-e4d360f9ead6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Getting quotas for user 43fefdc28eb54c9f8401bf11b8935065 and project 634952274d2748b988c4610754edc371. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:37:43.135007 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-32710bdc-efc3-495b-8cf3-e4d360f9ead6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.171993 Sep 02 21:37:43.135671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 552/1141] 10.222.0.99 () {60 vars in 1159 bytes} [Fri Sep 2 21:37:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:37:43.242487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3d664fb5-cb4b-4028-ab92-371c6faf4aba] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 21:37:43.242487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:43.242487 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=31 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:43.247074 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1357868114", "imageRef": "f5fd2aac-ea6c-42a3-a6eb-b54576bbc58f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-98727817", "networks": [{"uuid": "354b032e-d79f-42b1-a286-6cdd4c5e8d7b"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:37:43.302067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] validate_networks() for [('354b032e-d79f-42b1-a286-6cdd4c5e8d7b', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:37:43.707728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:37:43.708287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:37:43.708836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:37:43.709310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:37:43.709736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:37:43.718775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:43.719231 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:43.719662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:43.720390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:43.720973 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:43.721403 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:43.740084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Getting quotas for project 634952274d2748b988c4610754edc371. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:37:43.744978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Getting quotas for user 43fefdc28eb54c9f8401bf11b8935065 and project 634952274d2748b988c4610754edc371. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:37:43.757347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:37:43.759678 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5fd2aac-ea6c-42a3-a6eb-b54576bbc58f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:37:43.987026 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-614d1d6d-473c-427e-862d-4e27d4e40f03 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749801 Sep 02 21:37:43.988963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 590/1142] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:37:43.999686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07f0483d-4ea5-4592-b363-72a16a4ccfe8 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:44.000485 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-07f0483d-4ea5-4592-b363-72a16a4ccfe8 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:44.014390 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [-] [8501a5c8-dd6b-4b17-960b-99c3e32e2932] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 37714. Sep 02 21:37:44.063457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07f0483d-4ea5-4592-b363-72a16a4ccfe8 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:44.071228 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-07f0483d-4ea5-4592-b363-72a16a4ccfe8 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1257 microversion: 2.1 time: 0.075732 Sep 02 21:37:44.071802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 553/1143] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:43 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:45.096241 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-72520eb8-803a-415d-8a71-fdb7644dfccf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:45.096959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-72520eb8-803a-415d-8a71-fdb7644dfccf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:45.111766 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] [3d664fb5-cb4b-4028-ab92-371c6faf4aba] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 37722. Sep 02 21:37:45.153234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-72520eb8-803a-415d-8a71-fdb7644dfccf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:45.161943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-72520eb8-803a-415d-8a71-fdb7644dfccf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1257 microversion: 2.1 time: 0.070513 Sep 02 21:37:45.162535 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 591/1144] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:45 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:37:46.186874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1f3ba9d8-9228-4ca0-8ee8-f01855642fb0 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:46.187574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1f3ba9d8-9228-4ca0-8ee8-f01855642fb0 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:46.245482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f3ba9d8-9228-4ca0-8ee8-f01855642fb0 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:46.253285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1f3ba9d8-9228-4ca0-8ee8-f01855642fb0 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1257 microversion: 2.1 time: 0.070145 Sep 02 21:37:46.254275 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 554/1145] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:46 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:47.289117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f1d6a109-8e2f-4e9e-bc12-b30611847519 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:47.289750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1d6a109-8e2f-4e9e-bc12-b30611847519 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:47.343168 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f1d6a109-8e2f-4e9e-bc12-b30611847519 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:47.350804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f1d6a109-8e2f-4e9e-bc12-b30611847519 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1257 microversion: 2.1 time: 0.065854 Sep 02 21:37:47.351380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 592/1146] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:47 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:48.374819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:48.375410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:48.382322 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:48.382802 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:48.383237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:48.383928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:48.384384 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:48.384807 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:48.447116 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:48.454842 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f91c5141-693b-4d43-81d9-e5a11d6c7623 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1261 microversion: 2.1 time: 0.084377 Sep 02 21:37:48.455394 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 555/1147] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:48 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:48.903709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:48.904252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:48.912141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:48.912641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:48.913086 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:48.913884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:48.914325 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:48.914763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:48.940467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-58278520-533f-487d-8640-f2058aecdc55 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.258619 Sep 02 21:37:48.940976 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 593/1148] 10.222.0.99 () {58 vars in 1248 bytes} [Fri Sep 2 21:37:48 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/ips => generated 149 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:37:49.477547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:49.479260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:49.486392 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:49.487225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:49.487726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:49.488656 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:49.489251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:49.489915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:49.561235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:49.570765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-527fadc8-9b28-443c-ae5a-ee1fad85cd78 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1261 microversion: 2.1 time: 0.097789 Sep 02 21:37:49.571717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 556/1149] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:49 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:50.596210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:50.596822 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:50.603658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:50.604141 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:50.604578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:50.605367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:50.605770 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:50.606184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:50.674462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:50.686874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4bffd937-b15c-49d6-a095-7177cc59762e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1309 microversion: 2.1 time: 0.092737 Sep 02 21:37:50.686874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 594/1150] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:50 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:51.710075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:51.710721 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:51.717236 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:51.717843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:51.718291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:51.719264 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:51.719501 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:51.719937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:51.757246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cdc7bf0-17a4-4514-ba54-8db8535b1c61"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:37:51.760302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:51.766803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:51.767296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:51.767723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:51.768421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:51.768868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:51.769596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:51.783314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:51.791708 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-65cb7dfd-83db-4ca0-9ca6-584bf4747a61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1317 microversion: 2.1 time: 0.085531 Sep 02 21:37:51.792303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 557/1151] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:51 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:52.815702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:52.816420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:52.824259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:52.824775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:52.825225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:52.825967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:52.826430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:52.826870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:52.893002 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:52.902239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2effff30-38a4-4f5e-b584-779596dc2b42 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1317 microversion: 2.1 time: 0.090206 Sep 02 21:37:52.902838 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 558/1152] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:52 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:37:53.728314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:53.925498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:53.926056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:53.933315 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:53.933825 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:53.934267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:53.934966 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:53.935424 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:53.935853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:54.001069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:54.010066 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3967cc14-2bb4-4f85-bfc5-d34566212570 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1317 microversion: 2.1 time: 0.088415 Sep 02 21:37:54.011437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 559/1153] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:53 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1317 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:37:55.035517 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:55.036303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:55.044232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:55.044981 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:55.045792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:55.047098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:55.047509 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b805e1ae-2015-43fe-9536-7b460516948e tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "POST /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.293780 Sep 02 21:37:55.048208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 595/1154] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:37:51 2022] POST /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments => generated 194 bytes in 3295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:37:55.054246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:55.054246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:55.443008 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:55.456632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-350b4a4b-d595-43ed-b016-97294873ccea tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.426041 Sep 02 21:37:55.458632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 560/1155] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:55 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:56.487146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:56.487845 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:56.495757 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:56.496344 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:56.496893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:56.497745 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:56.498246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:56.498677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:56.638963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:56.650741 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-086f4f18-2347-4c85-8163-a4afa4cf7a56 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.168511 Sep 02 21:37:56.664919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 596/1156] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:56 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:57.678914 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:57.679845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:57.682316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:57.687220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:57.687713 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:57.688167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:57.688876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:57.689339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:57.690465 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:57.866238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:57.874853 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ed7af6ed-d947-449e-a129-54b0ac68ff2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.199800 Sep 02 21:37:57.875447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 561/1157] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:57 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:58.903796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:58.906640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:58.913262 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=10 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:58.919233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:58.919949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:58.920715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:58.921565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:58.922256 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:58.922686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:59.142057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:59.157955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c8aeb351-60c5-4540-bd7f-50ded7e4c957 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.262148 Sep 02 21:37:59.159275 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 597/1158] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:58 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:00.186696 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:00.187340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:00.194184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:00.194801 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:00.195572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:00.196319 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:00.196783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:00.197220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:00.341232 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:00.352762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ae23bc32-6c45-48a1-871b-f7b6d9384a9c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.168727 Sep 02 21:38:00.370305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 562/1159] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:00 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:01.379659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:01.380324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:01.387358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:01.387970 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:01.388413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:01.389164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:01.389622 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:01.390091 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:01.534779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:01.562068 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f0b955f9-e8e4-4846-a540-2d5224732f48 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.186226 Sep 02 21:38:01.562925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 598/1160] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:01 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:02.585094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:02.586064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:02.598630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:02.599448 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:02.600108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:02.601029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:02.601726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:02.602406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:02.756223 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1350041133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1904457527", "security_groups": [{"name": "tempest-secgroup-smoke-459655726"}], "block_device_mapping_v2": [{"uuid": "5cc310bd-e55e-4507-891e-7e1ef56947ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7eb9ec5-d03f-40fe-896f-85a06c8dd029"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:02.779124 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:02.787569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f8a187d6-956a-4f3e-9497-6166e99a5ed7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.206344 Sep 02 21:38:02.788151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 563/1161] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:02 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:02.889862 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] validate_networks() for [('f7eb9ec5-d03f-40fe-896f-85a06c8dd029', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:38:03.284132 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:38:03.284560 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:38:03.285036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:38:03.285446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:38:03.285903 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:38:03.296246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:03.296733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:03.297202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:03.297966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:03.298446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:03.298893 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:03.340695 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:38:03.347966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Getting quotas for user e9450f3f7527406ab70fcf0b64cab787 and project beb5b0e674994eabb1e18fde391c2484. Resources: {'ram', 'cores', 'instances'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:38:03.432115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:38:03.434784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cc310bd-e55e-4507-891e-7e1ef56947ad',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:38:03.810690 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:03.812260 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:03.819312 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:03.820674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:03.821396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:03.822373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:03.823330 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:03.823957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:03.960716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:03.969254 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-738ad1c3-55a6-4ebb-9580-951f2a37874b tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.162682 Sep 02 21:38:03.969865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 564/1162] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:03 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:04.844162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ba31f0d8-d1cd-46d9-abc9-155e4535979d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.091699 Sep 02 21:38:04.845007 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 599/1163] 10.222.0.99 () {60 vars in 1147 bytes} [Fri Sep 2 21:38:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:38:04.857105 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8f987c8a-0218-4530-9c59-fcb055cf59dd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:04.857781 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8f987c8a-0218-4530-9c59-fcb055cf59dd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:04.911641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8f987c8a-0218-4530-9c59-fcb055cf59dd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:04.920176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8f987c8a-0218-4530-9c59-fcb055cf59dd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1095 microversion: 2.1 time: 0.067144 Sep 02 21:38:04.920750 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 565/1164] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:04 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:04.995014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:04.995854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:05.004151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:05.004682 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:05.005119 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:05.006198 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:05.006830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:05.007937 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:05.153484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:05.162164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5eb0e023-5c7f-49d5-a0dd-22705e34c849 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.171380 Sep 02 21:38:05.165484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 600/1165] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:04 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:05.942982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-658e1c33-3b9e-4b23-98c8-feb53026f39f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:05.943616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-658e1c33-3b9e-4b23-98c8-feb53026f39f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:06.003830 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-658e1c33-3b9e-4b23-98c8-feb53026f39f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:06.011440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-658e1c33-3b9e-4b23-98c8-feb53026f39f tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1095 microversion: 2.1 time: 0.072253 Sep 02 21:38:06.012029 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 566/1166] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:05 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:06.186664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:06.187271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:06.193662 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:06.200343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:06.200343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:06.200343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:06.200343 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:06.200751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:06.348697 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:06.357615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-609383a5-cd36-474b-84c5-5aacb2a69e60 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.174883 Sep 02 21:38:06.358232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 601/1167] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:06 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:07.040047 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-577e8eaa-d79a-469a-88ba-24741dcdde3a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:07.040673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-577e8eaa-d79a-469a-88ba-24741dcdde3a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:07.346410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-577e8eaa-d79a-469a-88ba-24741dcdde3a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:07.354113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-577e8eaa-d79a-469a-88ba-24741dcdde3a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1095 microversion: 2.1 time: 0.317953 Sep 02 21:38:07.354695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 567/1168] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:07 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1095 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:07.381866 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:07.382779 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:07.389333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:07.389837 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:07.390274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:07.390992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:07.391422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:07.391899 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:07.521648 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:07.530018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-70468bd4-90b1-4f37-b237-337e808b4fd9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.151970 Sep 02 21:38:07.530610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 602/1169] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:07 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:08.377326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0f52fbb5-a89d-4c98-9fa6-cb9c7b47a496 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:08.377915 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0f52fbb5-a89d-4c98-9fa6-cb9c7b47a496 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:08.432905 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0f52fbb5-a89d-4c98-9fa6-cb9c7b47a496 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:08.439792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0f52fbb5-a89d-4c98-9fa6-cb9c7b47a496 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1095 microversion: 2.1 time: 0.066471 Sep 02 21:38:08.440349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 568/1170] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:08 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:08.554955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:08.556073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:08.563451 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:08.564481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:08.564481 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:08.565056 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:08.565512 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:08.565976 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:08.703096 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:08.711490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-95ce9077-12cc-4ee8-ab3c-2ce12f295e10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.161091 Sep 02 21:38:08.712070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 603/1171] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:08 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:09.462903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:09.463514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:09.469972 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:09.470481 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:09.470939 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:09.471666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:09.472146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:09.472586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:09.546949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:09.555146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-497a9fad-6e22-49af-8ac1-b4d47cfa1ed6 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1145 microversion: 2.1 time: 0.096391 Sep 02 21:38:09.555735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 569/1172] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:09 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:09.735369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:09.736048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:09.743172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:09.743698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:09.744144 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:09.744860 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:09.745319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:09.745788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:09.963077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:09.971573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c639d0e8-d4d6-4861-9e57-6fb4cc2c1e00 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.239925 Sep 02 21:38:09.982420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 604/1173] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:09 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:10.138355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:10.150095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:10.154514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:10.154514 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:10.163906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] Creating event network-changed:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:38:10.167928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR oslo.messaging._drivers.impl_rabbit [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] [0aae0b2e-6c3d-40e4-8cd2-ac3e13dce60d] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 21:38:10.585244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:10.585930 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:10.597814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:10.598503 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:10.599183 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:10.600089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:10.600580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:10.601012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:10.677579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:10.686598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-90f179d7-cf20-4f17-8d7b-63c7c43a3059 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1193 microversion: 2.1 time: 0.104671 Sep 02 21:38:10.687017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 605/1174] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:10 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:10.996222 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:10.996947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:11.003428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:11.003916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:11.004359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:11.005067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:11.005524 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:11.005988 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:11.138927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:11.146604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-db5d2631-f17e-42fd-9912-573581b5f4df tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.154434 Sep 02 21:38:11.147172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 606/1175] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:10 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:11.176340 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] [0aae0b2e-6c3d-40e4-8cd2-ac3e13dce60d] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 37942. Sep 02 21:38:11.180351 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-1a1ddfc5-8632-4af1-b020-9a2ef8c24d3b req-f4adfb92-6db5-4974-8596-42b3e627d455 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047066 Sep 02 21:38:11.180961 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 570/1176] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:11.711657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:11.712267 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:11.718233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:11.718715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:11.719150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:11.719835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:11.720287 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:11.720711 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:11.781114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:11.789966 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-806cd6f3-6e84-4e0b-830c-70333c2c54a3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1193 microversion: 2.1 time: 0.082638 Sep 02 21:38:11.790640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 607/1177] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:11 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:12.170980 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:12.171695 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:12.178133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:12.178760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:12.179188 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:12.179894 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:12.180356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:12.180787 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:12.316194 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:12.324857 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a07b4392-1a17-4f6f-a476-03550d6aa17d tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.158534 Sep 02 21:38:12.325439 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 571/1178] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:12 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:12.812390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:12.813011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:12.819915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:12.820378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:12.820815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:12.821522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:12.822000 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:12.822428 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:12.885011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:12.888416 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:12.892850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5352c8c0-e18d-49f1-84cf-852d4e4e9b67 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1193 microversion: 2.1 time: 0.084311 Sep 02 21:38:12.893418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 608/1179] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:12 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:13.349341 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:13.350002 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:13.353075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:13.358170 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:13.358670 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:13.359169 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:13.359887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:13.360353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:13.360792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:13.573547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:13.581287 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6a7ce6b8-d38a-42f6-841d-ae0ed01f0571 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.235788 Sep 02 21:38:13.581911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 572/1180] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:13 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:13.915996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:13.916763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:13.922458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:13.925591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:13.925591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:13.927224 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:13.927846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:13.928467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:13.929892 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:13.930409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:13.930838 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:13.999014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:14.006718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c32b8541-c6bf-4eab-b3b1-73abf54b6262 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1201 microversion: 2.1 time: 0.094659 Sep 02 21:38:14.007897 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 609/1181] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:13 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:14.605790 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:14.606437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:14.614558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:14.614558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:14.614558 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:14.615239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:14.615483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:14.615755 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:14.783831 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:14.793633 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b074f2f-2b66-45ba-885d-077013de5ba5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.191776 Sep 02 21:38:14.794281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 573/1182] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:14 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:15.042827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:15.043359 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:15.051385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:15.051870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:15.052303 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:15.053005 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:15.053456 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:15.053912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:15.195723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:15.203455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-44e86985-35a0-4208-a8a8-9b59c2e70149 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1278 microversion: 2.1 time: 0.175205 Sep 02 21:38:15.204048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 610/1183] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:15 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:15.750477 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2e2ad4-ffac-4582-9098-5ecd278a65a1", "tag": "3832cf9b-674c-496c-ad7f-65d73d0637c8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:15.760452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:15.760946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:15.761383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:15.774967 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] Creating event network-changed:3832cf9b-674c-496c-ad7f-65d73d0637c8 for instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 on hv-cinder-85221 Sep 02 21:38:15.780099 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-1a2a6855-cb2e-4caa-9151-d15fa2fb9b37 req-9c1399c1-1bc1-4fc0-95f7-45020c8374c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033299 Sep 02 21:38:15.780709 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 574/1184] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:15.818360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:15.819208 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:15.826027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:15.828841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:15.828841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:15.828841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:15.828841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:15.829293 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:15.957030 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:15.966187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-844dc2be-967b-493e-a858-a8e195ada156 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.152160 Sep 02 21:38:15.966849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 611/1185] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:15 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:16.228542 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:16.229510 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:16.236259 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:16.236955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:16.237529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:16.238398 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:16.239508 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:16.240022 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:16.378423 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:16.387969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9bf553d6-a334-4757-affe-2e5bcd51ac97 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1278 microversion: 2.1 time: 0.164358 Sep 02 21:38:16.388564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 575/1186] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:16 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:16.989342 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:16.990172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:16.998751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:16.999358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:16.999905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.000640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.001305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.001769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.110403 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "name": "network-vif-plugged", "status": "completed", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:17.127557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.128367 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.128989 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.148165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] Creating event network-vif-plugged:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:38:17.155158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-8f19b33e-03b0-44e1-97dd-d8cb4870b50d req-bc87b77b-bc5e-4860-84f7-e917a6a43612 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055864 Sep 02 21:38:17.160041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 576/1187] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:17.161914 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:17.170917 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f8fc0155-6356-4d64-b078-ff18e2becf66 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.185553 Sep 02 21:38:17.171505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 612/1188] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:16 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:17.413155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:17.413931 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:17.420563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.421238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.421674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.422441 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.422952 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.423368 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.443385 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:17.567969 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:17.576736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ccf705da-27e8-4957-8e39-8bedb5bd7a9d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1278 microversion: 2.1 time: 0.168312 Sep 02 21:38:17.577318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 577/1189] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:17 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:17.843388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:17.843888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:17.850052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.853723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.853723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.853723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:17.853723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:17.854112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:17.935057 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'services' on Instance uuid 84c80b55-4fc6-479e-92f0-990ccf8156e6 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:38:18.195214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:18.195769 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:18.202211 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.202698 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.203129 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.203874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.204346 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.204748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.213414 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-55cf86ff-05b9-403c-b15b-347668e79bbb tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments/4cdc7bf0-17a4-4514-ba54-8db8535b1c61" status: 202 len: 0 microversion: 2.1 time: 0.373931 Sep 02 21:38:18.217610 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 613/1190] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:38:17 2022] DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments/4cdc7bf0-17a4-4514-ba54-8db8535b1c61 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:38:18.223907 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:18.227001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:18.232923 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.233409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.233872 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.234575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.235067 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.235490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.273284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-72e4a079-cab9-404a-868a-85287302b730 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054067 Sep 02 21:38:18.274120 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 614/1191] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:38:18 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:18.350051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:18.358143 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5b06c3da-dbbe-4a1b-b42d-f7dbdc2e2f31 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.167532 Sep 02 21:38:18.358717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 578/1192] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:18 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:18.599744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:18.601095 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:18.607367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.607854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.608322 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.609089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:18.609547 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:18.610006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:18.759791 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:18.767877 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ed578377-580a-4787-a1fb-bb166f0e13f3 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1278 microversion: 2.1 time: 0.172063 Sep 02 21:38:18.768515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 615/1193] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:18 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:19.285947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:19.288773 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:19.290754 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:19.296135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.296640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.297102 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.298173 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.298918 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.299561 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.332832 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-917b959c-57bc-49e2-b5c5-3113b87bbe3f tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Sep 02 21:38:19.333406 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 579/1194] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:38:19 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:19.381080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:19.382294 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:19.388886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.389367 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.389841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.390534 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.390984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.391405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.526113 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:19.533680 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6451fd47-21b0-472a-aee9-97cabf817efe tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1357 microversion: 2.1 time: 0.156533 Sep 02 21:38:19.534521 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 616/1195] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:19 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:19.791141 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:19.791753 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:19.798224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.798704 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.799140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.799884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:19.800338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:19.800766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:19.933971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:19.941686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4c78f2b6-1027-409f-ae08-e7f0b77f3bb1 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.154702 Sep 02 21:38:19.942360 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 580/1196] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:19 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:20.346658 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:20.349378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:20.356055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.356535 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.356990 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.357670 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.358147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.358571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.388857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a9b096ce-f1b7-435e-b528-9192acd5507c tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Sep 02 21:38:20.389539 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 617/1197] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:38:20 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:20.556551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:20.557159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:20.563686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.564174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.564612 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.565311 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.565788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.566222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.700225 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:20.708080 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5f427661-d64c-4d96-8601-0ed96b1a5817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1547 microversion: 2.1 time: 0.155464 Sep 02 21:38:20.708651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 581/1198] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:20 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:20.733699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:20.734385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:20.740815 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.745595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.745595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.745595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.745595 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.746628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.878767 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:20.887269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cb0cda4d-ea21-463f-9be9-b43a90bf9c45 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1547 microversion: 2.1 time: 0.158592 Sep 02 21:38:20.887943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 618/1199] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:20 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:20.910765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:20.915916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:20.916585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Searching by: {'deleted': False, 'project_id': '634952274d2748b988c4610754edc371'} {{(pid=121277) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 02 21:38:20.923407 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.923944 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.924383 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.925118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.925571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.926118 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.965109 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:20.966027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:20.972143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.976518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.976518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:20.976518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:20.976518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:20.977283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.023618 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.multi_cell_list [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 02 21:38:21.121599 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-94838799-e7cf-4a95-9353-51dba676daeb tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214979 Sep 02 21:38:21.122135 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 582/1200] 10.222.0.99 () {58 vars in 1125 bytes} [Fri Sep 2 21:38:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:21.127951 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:21.134557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:21.135180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:21.137435 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-492f04c5-cda8-47ae-a9fd-5bb43e2f2dbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.176156 Sep 02 21:38:21.138060 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 619/1201] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:20 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:21.141428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.142016 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.142461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.143174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.143636 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.144071 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.278652 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:21.286595 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d27c887f-3e63-4cd0-83cf-b4a3afa867cc tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1547 microversion: 2.1 time: 0.156506 Sep 02 21:38:21.287175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 583/1202] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:21 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:21.400933 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:21.403232 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:21.409857 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.410352 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.410800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.411504 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.411964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.412393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.443405 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bfb2a7b6-6013-427f-b3f4-106c1798fee6 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046541 Sep 02 21:38:21.444036 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 620/1203] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:38:21 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:38:21.509613 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:21.510246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:21.516733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.517212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.520412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.520412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:21.520412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:21.520412 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:21.548167 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:38:22.160792 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:22.161313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:22.166325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a6194f9b-3808-4e94-beed-e9f69262d3f5 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 204 len: 0 microversion: 2.1 time: 0.660898 Sep 02 21:38:22.167139 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 584/1204] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:38:21 2022] DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:38:22.170665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:22.183349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:22.183349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:22.183349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:22.183349 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:22.183842 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:22.183943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:22.183943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:22.183943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:22.183943 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:22.184325 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:22.184553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:22.185014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:22.185454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:22.380327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:22.384133 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:22.390175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8144afab-0906-46a8-8919-e6ae8a3dbbbe tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.233515 Sep 02 21:38:22.390754 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 621/1205] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:22 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:22.392617 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0f3d0cd6-534d-47b4-b886-14e781c83b56 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1680 microversion: 2.1 time: 0.220983 Sep 02 21:38:22.393201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 585/1206] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:22 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:23.096458 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:23.097228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:23.104177 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.104617 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.105058 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.105788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.106248 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.106734 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.131836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lazy-loading 'flavor' on Instance uuid 8fc20ae9-3b10-407b-b448-fe0c5f99e264 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:38:23.416437 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:23.416975 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:23.423843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.424341 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.424791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.425515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.426005 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.426441 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.487311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:23.497333 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e7b17c4-6c94-4396-9c28-6469449e749f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "POST /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264/action" status: 202 len: 0 microversion: 2.1 time: 0.404710 Sep 02 21:38:23.497959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 622/1207] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:38:23 2022] POST /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:38:23.503176 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:23.503874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:23.510221 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.510715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.511155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.511865 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.512320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.512775 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.625829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:23.634654 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-87df52a7-ae9a-4f72-bac9-ac53c796c707 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.223160 Sep 02 21:38:23.635397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 586/1208] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:23 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:23.640045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:23.640649 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:23.655359 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.655999 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.656576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.657297 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:23.657777 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:23.658209 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:23.674832 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:23.683035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c2b5d5c6-0264-4386-9b76-2402338b3b72 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1680 microversion: 2.1 time: 0.183891 Sep 02 21:38:23.684164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 623/1209] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:23 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:23.793534 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:23.801362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9a0e5c00-8acd-4860-b067-87af232841c5 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.165015 Sep 02 21:38:23.802104 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 587/1210] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:23 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:24.390187 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eaf9dec-34dc-4626-b668-0f842edac8b5"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:24.392965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:24.400025 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.400514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.400954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:24.401659 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.402147 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.402579 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:24.658014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:24.658763 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:24.667302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.667827 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.668271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:24.669006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.669461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.669913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:24.829199 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:24.838191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3177aa87-feb5-440f-8ef1-c6b60f87c892 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.183971 Sep 02 21:38:24.848661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 588/1211] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:24 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:24.855752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:24.856373 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:24.862788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.863293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.863733 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:24.864445 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:24.864945 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:24.865371 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:25.005741 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:25.014642 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c860d96e-9e54-46c7-968a-709fc4ce557a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1680 microversion: 2.1 time: 0.164158 Sep 02 21:38:25.015309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 589/1212] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:24 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:25.019671 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:25.020272 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:25.028430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:25.033309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:25.033309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:25.033309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:25.033309 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:25.034348 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:25.176452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:25.187063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-015e2cff-fb77-4bc9-a42c-0e478bd27728 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.170622 Sep 02 21:38:25.187661 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 590/1213] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:25 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:25.279890 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-45afb9cc-0f9f-462d-844d-bc2855da42e3 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893842 Sep 02 21:38:25.280453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 624/1214] 10.222.0.99 () {60 vars in 1323 bytes} [Fri Sep 2 21:38:24 2022] POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:38:25.653289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c80b55-4fc6-479e-92f0-990ccf8156e6", "name": "network-vif-deleted", "tag": "47d37144-8305-4222-a176-d86a434a6a00"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:25.670190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:25.672195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:25.672195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:25.684285 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] Creating event network-vif-deleted:47d37144-8305-4222-a176-d86a434a6a00 for instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 on hv-cinder-85221 Sep 02 21:38:25.689577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-fe2ec81a-18cc-49bf-a33b-5899290ac9fa req-d9b62cd5-584e-4cc0-8110-7d64279f9efd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040005 Sep 02 21:38:25.690247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 591/1215] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:25.863987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:25.864687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:25.871720 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:25.872103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:25.872535 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:25.873236 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:25.873683 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:25.874131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.015797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:26.024627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1f093995-c008-4a15-b331-8d170ed1e8cf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.165556 Sep 02 21:38:26.025210 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 625/1216] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:25 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:26.038946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:26.039674 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:26.046116 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:26.046855 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:26.047299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.048006 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:26.048509 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:26.048886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.080362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:26.080849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:26.081289 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.081759 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'fault' on Instance uuid 84c80b55-4fc6-479e-92f0-990ccf8156e6 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:38:26.085220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:26.126527 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:26.135090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2e5344f-c671-4eb6-83e0-f6ed120d1868 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1330 microversion: 2.1 time: 0.101427 Sep 02 21:38:26.135669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 592/1217] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:26 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:26.212326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:26.213098 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:26.219555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:26.220155 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:26.220592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.221320 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:26.221830 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:26.227307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:26.378728 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:26.388358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-66eaea47-a17b-407f-85bf-228443e4212f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.180733 Sep 02 21:38:26.388939 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 626/1218] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:26 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:27.048911 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:27.049543 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:27.056956 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.057519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.057993 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.058679 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.059131 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.059578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.158699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:27.159565 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:27.168592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.169421 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.170127 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.171272 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.171991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.172668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.201223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:27.211069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-33e92590-82a1-4242-960a-30f19653930d tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.165067 Sep 02 21:38:27.211752 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 593/1219] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:27 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:27.218522 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.219006 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.221985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.224314 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lazy-loading 'fault' on Instance uuid 84c80b55-4fc6-479e-92f0-990ccf8156e6 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:38:27.268291 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2ee46e8302468bb90ee913eeeba4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8efd74da71400a83f05127451c13fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:27.276927 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0759c25a-0ceb-4ab0-be79-40421c0aa043 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 200 len: 1330 microversion: 2.1 time: 0.122020 Sep 02 21:38:27.277514 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 627/1220] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:27 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:27.415362 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:27.416298 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:27.422452 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.422950 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.423386 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.424091 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:27.424547 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:27.424976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:27.567616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:27.576400 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-41ec47a4-3a84-4615-bd96-4a3628485d5e tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.165560 Sep 02 21:38:27.576987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 594/1221] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:27 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:28.234518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:28.235138 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:28.242581 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.243146 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.244013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.244474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.245012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.245887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.301457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:28.302103 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:28.309441 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.309970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.310411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.311175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.311629 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.312053 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.329281 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 HTTP/1.1 Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:38:28.330577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:28.332421 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '84c80b55-4fc6-479e-92f0-990ccf8156e6'} Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:28.333461 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:28.344847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:28.346401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:28.346401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-98224d0c-584f-402d-a815-1348b3860f30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 404 len: 111 microversion: 2.1 time: 0.035649 Sep 02 21:38:28.346401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 595/1222] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:28 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:38:28.346401 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b0754396-766f-4eb5-bafa-0ba763547b30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '.version_select at 0x7faac0fc2820>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:28.383999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:28.392353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6de396d0-26ff-4cbd-84af-b6392d05bb49 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.161705 Sep 02 21:38:28.392953 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 628/1223] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:28 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:28.418146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b0754396-766f-4eb5-bafa-0ba763547b30 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615418862" status: 202 len: 0 microversion: 2.1 time: 0.078328 Sep 02 21:38:28.418737 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 596/1224] 10.222.0.99 () {58 vars in 1221 bytes} [Fri Sep 2 21:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615418862 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:38:28.600870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:28.600870 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:28.607341 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.607926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.608374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.609080 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:28.609529 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:28.609978 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:28.775274 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:28.783170 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f2d0f4bb-4fad-41a9-839e-f1318df62c90 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.186947 Sep 02 21:38:28.783806 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 629/1225] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:28 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:29.416004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:29.416619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:29.423484 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:29.423964 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:29.424407 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:29.425097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:29.425570 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:29.426015 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:29.561004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:29.571113 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c57dc009-512d-4668-ad00-f9e4b9916fd4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.159678 Sep 02 21:38:29.571793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 597/1226] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:29 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:29.806778 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:29.807475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:29.815148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:29.815846 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:29.816296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:29.817012 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:29.817472 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:29.817959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:29.959591 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:29.967253 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b5a0788-8437-4773-8279-28a0284f47f7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.164946 Sep 02 21:38:29.967816 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 630/1227] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:29 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:30.593453 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:30.594098 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:30.601571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.602083 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.602528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.603256 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.603714 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.604175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.667206 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:30.667727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:30.673626 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.674157 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.674797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.675498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.675955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.676393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.690115 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 HTTP/1.1 Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:38:30.691784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.693368 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '84c80b55-4fc6-479e-92f0-990ccf8156e6'} Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:30.694772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.696181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.698143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:30.698143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-07fd9506-3d9f-4400-b719-934f775df168 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 404 len: 111 microversion: 2.1 time: 0.029932 Sep 02 21:38:30.698143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 631/1228] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:38:30 2022] DELETE /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:38:30.702327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:30.703014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 84c80b55-4fc6-479e-92f0-990ccf8156e6] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:30.709075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.710313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.710812 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.711531 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:30.711993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:30.712424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:30.726390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 HTTP/1.1 Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:38:30.727955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.729850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '84c80b55-4fc6-479e-92f0-990ccf8156e6'} Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:30.730868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. Sep 02 21:38:30.732434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:30.734790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 84c80b55-4fc6-479e-92f0-990ccf8156e6 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:30.734790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3ded5c5d-70a0-4f7d-b6a9-4cf596e15327 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6" status: 404 len: 111 microversion: 2.1 time: 0.030804 Sep 02 21:38:30.734790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 632/1229] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:30 2022] GET /compute/v2.1/servers/84c80b55-4fc6-479e-92f0-990ccf8156e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:38:30.746614 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:30.754246 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6d5f0073-e9a4-4f9d-a2d0-f8626febc0a7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.164668 Sep 02 21:38:30.754814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 598/1230] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:30 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:30.993160 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:30.993961 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:31.000520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:31.001009 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:31.001451 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:31.002190 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:31.002724 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:31.003159 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:31.143904 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2e2ad4-ffac-4582-9098-5ecd278a65a1", "name": "network-vif-plugged", "status": "completed", "tag": "3832cf9b-674c-496c-ad7f-65d73d0637c8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:31.148762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:31.153573 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:31.153982 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:31.154459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:31.154885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:31.161749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e8a18cbb-21ca-44e5-a462-0d1183cea1aa tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.173476 Sep 02 21:38:31.162308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 633/1231] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:30 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:31.168600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] Creating event network-vif-plugged:3832cf9b-674c-496c-ad7f-65d73d0637c8 for instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 on hv-cinder-85221 Sep 02 21:38:31.175930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-2e584d81-7eac-4e2f-bd84-e5b7e6edd842 req-1b58b7f7-f7aa-4cf3-b3bf-c07b739c3e99 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035818 Sep 02 21:38:31.176585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 599/1232] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:38:31.778709 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:31.779242 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:31.785585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:31.786110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:31.786589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:31.787284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:31.788391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:31.788826 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:31.925546 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:31.933887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8ea93518-ed43-45c6-af20-085e8a6df607 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.159314 Sep 02 21:38:31.934455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 634/1233] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:31 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:32.075690 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.076278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.082847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.083328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.083760 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.084954 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.085410 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.085859 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.098941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d HTTP/1.1 Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:38:32.101237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.102971 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '9f8ac4fe-677d-40b0-a232-2bac3efd019d'} Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:32.103953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.105459 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.107041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:32.107041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8a178f3b-eddb-41a4-9fe7-70acfa728fab tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 404 len: 111 microversion: 2.1 time: 0.031849 Sep 02 21:38:32.107041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 600/1234] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:38:32 2022] DELETE /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:38:32.111443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.112062 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: 9f8ac4fe-677d-40b0-a232-2bac3efd019d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.118530 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.119014 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.119455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.120150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.120609 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.121040 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.135048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d HTTP/1.1 Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:38:32.136600 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.138237 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '9f8ac4fe-677d-40b0-a232-2bac3efd019d'} Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:32.139180 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. Sep 02 21:38:32.140731 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.142410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance 9f8ac4fe-677d-40b0-a232-2bac3efd019d could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:32.142410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2043f582-1529-419c-a57b-3dca05572787 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d" status: 404 len: 111 microversion: 2.1 time: 0.030459 Sep 02 21:38:32.142410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 635/1235] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:32 2022] GET /compute/v2.1/servers/9f8ac4fe-677d-40b0-a232-2bac3efd019d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:38:32.146624 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.148214 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.154156 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.154638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.155078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.155766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.156220 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.156644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.170399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 HTTP/1.1 Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:38:32.171925 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.173664 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'd6d45104-6397-4740-ad90-b74822d88474'} Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:32.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.176179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.177682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:32.177682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c41e53ef-7154-4772-9b3e-070d12d80c22 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 404 len: 111 microversion: 2.1 time: 0.030514 Sep 02 21:38:32.177682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 601/1236] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:38:32 2022] DELETE /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:38:32.182336 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.182954 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: d6d45104-6397-4740-ad90-b74822d88474] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.186041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.186660 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.188977 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.189467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.189968 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.190664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.191117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.191543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.192669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.193155 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.194213 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.194833 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.195291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.195722 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.206001 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 HTTP/1.1 Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:38:32.207628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.210330 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'd6d45104-6397-4740-ad90-b74822d88474'} Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:32.211394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. Sep 02 21:38:32.212943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:32.214471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance d6d45104-6397-4740-ad90-b74822d88474 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:32.214471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-be3c71af-ebd7-4a4f-b3cf-d69fe125e414 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474" status: 404 len: 111 microversion: 2.1 time: 0.031203 Sep 02 21:38:32.214471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 636/1237] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:32 2022] GET /compute/v2.1/servers/d6d45104-6397-4740-ad90-b74822d88474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:38:32.332150 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:32.348467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f88ee9b-649e-496a-8cb7-726c91be7127 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.158647 Sep 02 21:38:32.348467 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 602/1238] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:32 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:32.956633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:32.957164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:32.963518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.964015 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.964473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:32.965192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:32.965651 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:32.966110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.105393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:33.113158 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f700c63-e084-4767-b23a-de32403d322b tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1266 microversion: 2.1 time: 0.160518 Sep 02 21:38:33.116627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 637/1239] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:32 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:33.364588 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:33.365185 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:33.372056 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.372544 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.373200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.374165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.374820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.375681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.510689 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:33.529178 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8a366e99-7b8d-470d-ab5d-c41d05b46351 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.167437 Sep 02 21:38:33.533783 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 603/1240] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:33 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:33.549901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:33.550396 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:33.556946 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.557424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.557889 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.558578 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.559026 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.559446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.572424 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d HTTP/1.1 Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:38:33.574017 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.575699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': 'f7a53988-5e75-44d2-9cb2-6f5c31e2144d'} Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:33.576660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.578087 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.579415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:33.579415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e7e058c-c229-4907-a953-4a80de9f458a tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 404 len: 111 microversion: 2.1 time: 0.029420 Sep 02 21:38:33.579415 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 638/1241] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:38:33 2022] DELETE /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:38:33.583822 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:33.584937 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] [instance: f7a53988-5e75-44d2-9cb2-6f5c31e2144d] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:33.590921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.591396 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.591828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.592511 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:33.592960 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:33.593382 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:33.607162 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] HTTP exception thrown: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Request method failure captured: Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d HTTP/1.1 Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnUVAFuSpOY8sZz_967G9Ck7VdCe5CX0fJ5nJwQkVKTxaiq3nBLI4yelQwYmiLI2BbeyCuiLsX35gWF4-wkRidm9R5L58W1rcIj2m90fG5R0UYw2xfa6pV5q2nuMb9DfOhdHEzdpK8AqpHL2O9Ktj7c4BYk_qkE2bs3DKeb_-CBVUDU Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:38:33.608688 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/de8efd74da71400a83f05127451c13fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/de8efd74da71400a83f05127451c13fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_de8efd74da71400a83f05127451c13fd", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: de8efd74da71400a83f05127451c13fd Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-274796601 Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 7d2ee46e8302468bb90ee913eeeba4af Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-274796601-project Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.610215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'f7a53988-5e75-44d2-9cb2-6f5c31e2144d'} Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:38:33.611070 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. Sep 02 21:38:33.613100 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:38:33.614875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] Returning 404 to user: Instance f7a53988-5e75-44d2-9cb2-6f5c31e2144d could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:38:33.614875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5e1bc4fa-0b4a-4439-8b1f-902a8fd95f29 tempest-AttachVolumeNegativeTest-274796601 tempest-AttachVolumeNegativeTest-274796601-project] 10.222.0.99 "GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d" status: 404 len: 111 microversion: 2.1 time: 0.030007 Sep 02 21:38:33.614875 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 604/1242] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:33 2022] GET /compute/v2.1/servers/f7a53988-5e75-44d2-9cb2-6f5c31e2144d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:38:34.137388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:34.138035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:34.144490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.144965 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.145413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.146148 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.146619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.147615 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.552579 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:34.553357 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:34.560575 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.561057 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.561486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.562221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.562673 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.563094 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.731117 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:34.747758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ac3a693-53e5-4ead-b145-fe832f261da4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1452 microversion: 2.1 time: 0.614425 Sep 02 21:38:34.748422 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 639/1243] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:34 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1452 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:34.774393 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:34.775021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:34.780936 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.781466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.781948 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.782660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:34.783129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:34.783555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:34.919089 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:34.935460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9b9a9689-9067-4117-a557-57d980406223 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.386309 Sep 02 21:38:34.936574 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 605/1244] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:34 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:35.054173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:35.054173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f0edf5e8-aef2-40a8-b4bf-e6325741eb2c tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1452 microversion: 2.1 time: 0.274070 Sep 02 21:38:35.054173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 640/1245] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:34 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:35.068446 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:35.069615 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:35.076636 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:35.077226 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:35.077820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:35.078634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:35.079224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:35.079953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:35.285563 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:35.294426 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52fac452-7596-4210-a09f-56def2ee0d8f tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1593 microversion: 2.1 time: 0.229753 Sep 02 21:38:35.295190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 606/1246] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:35 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1593 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:35.964975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:35.969271 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:35.979008 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:35.979827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:35.980285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:35.981214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:35.981621 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:35.981960 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:35.988166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:36.212789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:36.221227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b75105b-b942-426c-89cc-cd7994db2459 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.261951 Sep 02 21:38:36.222309 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 641/1247] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:35 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:37.254729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:37.254729 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:37.264082 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:37.264634 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:37.265154 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:37.266222 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:37.266487 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:37.267865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:37.489529 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:37.498906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e964488-94a4-413d-9494-0bf8619ba7ca tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.256494 Sep 02 21:38:37.500050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 607/1248] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:37 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:38.528856 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:38.530976 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:38.539218 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:38.539781 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:38.540482 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:38.541292 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:38.542391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:38.542912 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:38.684885 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:38.694245 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8eae010b-e4cb-4fb1-b8a3-76717f25fd60 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.168931 Sep 02 21:38:38.694931 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 642/1249] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:38 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:39.352594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2e2ad4-ffac-4582-9098-5ecd278a65a1", "tag": "3832cf9b-674c-496c-ad7f-65d73d0637c8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:39.370717 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:39.371620 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:39.372317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:39.389994 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] Creating event network-changed:3832cf9b-674c-496c-ad7f-65d73d0637c8 for instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 on hv-cinder-85221 Sep 02 21:38:39.399803 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-59a7f2ab-8632-4fcb-87b2-4880dcd08fe4 req-c29c77cb-7133-413f-ab10-d8a52b8b41bf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052240 Sep 02 21:38:39.401165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 608/1250] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:39.717055 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:39.718596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:39.725386 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:39.726561 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:39.727246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:39.728202 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:39.728896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:39.729540 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:39.888983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:39.905159 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2938c602-73ef-40f9-8dff-e804d65f3aef tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.192391 Sep 02 21:38:39.906612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 643/1251] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:39 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:40.931065 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:40.932938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:40.939399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:40.939399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:40.939399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:40.939916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:40.940399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:40.940820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:41.132747 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:41.141339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f93ba712-6804-4772-b42b-e9fd7f3dafc8 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.215706 Sep 02 21:38:41.142350 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 609/1252] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:40 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:41.416235 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:41.426399 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:41.426882 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:41.427321 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:41.438844 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] Creating event network-changed:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:38:41.444735 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-86aec8ba-9bbe-4cc3-815c-b3df96d41861 req-3f5a524e-0b1e-4cbb-bccb-0c7d0fb4369e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032722 Sep 02 21:38:41.445335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 644/1253] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:38:42.165797 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:42.166457 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:42.176069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:42.176577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:42.177184 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:42.177965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:42.178417 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:42.178844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:42.346031 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:42.354219 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2bc95de4-4233-43c4-96b6-5a9b6c1a4079 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.193314 Sep 02 21:38:42.354809 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 610/1254] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:42 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:43.166243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-172801931"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:43.166875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:43.172986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.173473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.173950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.174641 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.175093 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.175519 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.328089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.network.security_group_api [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Adding security group 63aad085-e4be-446c-b566-367e05f9ebe9 to port ae056596-48a8-487f-9e26-45fe8ab0864c Sep 02 21:38:43.381780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:43.381780 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:43.386716 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.387212 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.387672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.388379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.388844 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.389278 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.604257 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:43.617778 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5894aefd-5c7f-40c4-9949-1eba64cbf039 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.242186 Sep 02 21:38:43.619191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 611/1255] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:43 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:38:43.831538 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1295f208-bb27-456f-bb54-9a36050b9ae2 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action" status: 202 len: 0 microversion: 2.1 time: 0.670230 Sep 02 21:38:43.832273 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 645/1256] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:38:43 2022] POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:38:43.840356 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:43.840973 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:43.841104 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:38:43.843004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:43.847814 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.848267 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.848701 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.850970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.851165 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:43.859962 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.860607 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:43.860718 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.860816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:43.872143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] Creating event network-changed:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:38:43.878759 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-b2e3cba8-b5e3-4134-a38f-8c3791705db6 req-cf6cf3d9-42c4-496f-9ef1-0c204c0a1cc4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041139 Sep 02 21:38:43.879704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 646/1257] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:38:44.073004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:44.088075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-950dcdcc-f19f-4d93-8436-ea1b4ade8f2e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1757 microversion: 2.1 time: 0.250193 Sep 02 21:38:44.090502 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 612/1258] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:43 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:44.643571 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:44.644389 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:44.651254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:44.651736 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:44.652164 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:44.653052 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:44.653505 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:44.653959 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:44.805855 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:44.814114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8a0fa4d1-c31c-4ce3-b2ef-29ae49f20e1d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.175167 Sep 02 21:38:44.814660 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 647/1259] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:44 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:45.836900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:45.837444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:45.844927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:45.845418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:45.845899 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:45.846604 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:45.847068 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:45.847504 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:45.981354 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:45.989159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f95a7d48-9cbf-487d-993a-55c8f4a5b6e4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.156637 Sep 02 21:38:45.990025 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 613/1260] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:45 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:47.013246 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:47.013878 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:47.016467 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=80 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:47.021434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:47.021998 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:47.022438 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:47.023150 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:47.023605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:47.024035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:47.174751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:47.183715 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fd753e0d-97fe-4a2f-ae51-d5821976c2cc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.174492 Sep 02 21:38:47.184302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 648/1261] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:47 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:48.207019 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:48.207586 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:48.214933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:48.215397 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:48.215829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:48.216553 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:48.217004 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:48.217428 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:48.221576 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:48.359672 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:48.368061 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e68b2849-9d17-4ada-bfff-7a0098117efc tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.164936 Sep 02 21:38:48.368650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 614/1262] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:48 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:49.392465 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:49.393038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:49.399972 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:49.400460 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:49.400896 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:49.401594 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:49.402081 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:49.402515 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:49.541564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:49.549302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8ce8090a-d33e-486a-b7ef-5d4125f18f30 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.160820 Sep 02 21:38:49.549900 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 649/1263] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:49 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:50.574090 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:50.574782 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:50.581171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:50.581650 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:50.582123 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:50.582816 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:50.583463 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:50.583686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:50.722991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:50.731644 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7bb513e3-21fe-4c50-be06-2c202cad8a2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.161625 Sep 02 21:38:50.737575 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 615/1264] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:50 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:51.754984 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:51.755598 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:51.762363 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:51.762852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:51.763285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:51.763982 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:51.764479 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:51.764904 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:51.905043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:51.913319 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-eea78d9c-5a0f-44e7-849b-14044c28f509 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.162314 Sep 02 21:38:51.914473 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 650/1265] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:51 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:52.938379 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:52.938953 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:52.945845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:52.946339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:52.947870 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:52.948483 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:52.948938 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:52.949372 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:53.127919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:53.137040 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-46f1c720-afbc-444e-bbbc-5c4db6e84689 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.202547 Sep 02 21:38:53.137995 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 616/1266] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:52 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:54.176859 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:54.177409 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:54.184471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:54.184955 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:54.185398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:54.186143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:54.186596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:54.187021 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:54.327793 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:54.335858 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-35c35b21-2a17-4575-b138-5c4a0b9a9f83 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.164896 Sep 02 21:38:54.336446 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 651/1267] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:54 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:55.361276 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:55.361935 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:55.369201 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:55.369818 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:55.370271 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:55.370986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:55.371447 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:55.371881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:55.519152 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:55.528195 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a0c0c84d-c4b4-491a-876c-3a55fe45c38b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.170762 Sep 02 21:38:55.528867 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 617/1268] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:55 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:56.565915 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:56.566566 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:56.574251 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:56.574734 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:56.575166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:56.575874 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:56.576313 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:56.576733 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:56.719355 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:56.728434 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-56f11348-c9f5-4699-9993-e0311697c9ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.165936 Sep 02 21:38:56.729103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 652/1269] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:56 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:57.751978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:57.752645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:57.759723 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:57.760239 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:57.761305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:57.762064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:57.762532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:57.762970 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:57.922014 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:57.931916 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2512867f-6557-4287-a357-0f7c95249391 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.183692 Sep 02 21:38:57.932641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 618/1270] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:57 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:38:58.956166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:38:58.956723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:38:58.964247 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:58.964734 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:58.965172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:58.965916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:38:58.966372 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:38:58.966800 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:38:59.110118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:38:59.123776 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-40b8f8e3-9974-4947-9c5c-3e4d6b880b64 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.171512 Sep 02 21:38:59.124370 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 653/1271] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:38:58 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:00.152418 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:00.153023 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:00.160045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:00.160546 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:00.160976 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:00.161666 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:00.162146 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:00.162567 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:00.315703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:00.324817 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9b412a2d-e364-4ba3-8ee5-8aa746507bbf tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.176917 Sep 02 21:39:00.325409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 619/1272] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:00 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:39:01.350925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:01.351813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:01.360297 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:01.360619 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:01.361564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:01.362114 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:01.362572 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:01.362996 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:01.526230 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:01.534810 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b030c539-4bd9-4a7a-b6e0-8e3aaa34106a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1568 microversion: 2.1 time: 0.187848 Sep 02 21:39:01.535394 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 654/1273] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:01 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:01.562700 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:39:01.563669 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:01.571900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:01.572381 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:01.573052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:01.573796 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:01.574521 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:01.574957 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:01.718932 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121277) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:39:02.136291 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4abfa5c1-4029-42a9-9a88-dba6a188df9f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "POST /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264/action" status: 202 len: 0 microversion: 2.1 time: 0.578209 Sep 02 21:39:02.136927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 620/1274] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:39:01 2022] POST /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:39:02.145700 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:02.147077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:02.154033 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:02.154841 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:02.155011 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:02.155690 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:02.156145 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:02.156574 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:02.299918 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:02.311279 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e87d64ea-f303-43f8-a9b9-f788adb55ef7 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1576 microversion: 2.1 time: 0.169779 Sep 02 21:39:02.312194 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 655/1275] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:02 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:03.336454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:03.337649 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:03.347339 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:03.347835 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:03.348273 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:03.349175 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:03.349640 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:03.350095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:03.505286 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:03.514087 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c885d0a1-97cc-4723-8379-251c4debb6a6 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1518 microversion: 2.1 time: 0.182131 Sep 02 21:39:03.514983 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 621/1276] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:03 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:04.539672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:04.540885 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:04.549484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:04.550084 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:04.550523 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:04.551228 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:04.551702 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:04.552110 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:04.702276 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:04.713171 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-372da8e4-b0c1-426d-8159-07f4c2f8102f tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1518 microversion: 2.1 time: 0.177848 Sep 02 21:39:04.713665 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 656/1277] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:04 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:05.237702 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "name": "network-vif-unplugged", "status": "completed", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:39:05.250030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:05.250030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:05.250030 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:05.263598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] Creating event network-vif-unplugged:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:39:05.271096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-10a7cdbf-b5f6-4109-aa7b-f07a2b162738 req-b8ccb816-ef4e-47c7-a25b-1586e963dbb0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039010 Sep 02 21:39:05.272349 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 622/1278] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:39:05.737266 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:05.738035 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:05.746730 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:05.747227 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:05.747672 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:05.748391 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:05.748849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:05.749280 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:05.999140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:05.999140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d17d4722-4b8e-4d50-9a38-6a556f2ec118 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.181014 Sep 02 21:39:05.999140 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 657/1279] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:05 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:07.011900 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:07.012627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:07.018988 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:07.019486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:07.019941 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:07.020651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:07.021304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:07.021765 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:07.270676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:07.282991 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6848506a-a443-4d42-872a-71fdcf05a1a4 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.275915 Sep 02 21:39:07.283582 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 623/1280] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:07 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:08.311106 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:08.312069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:08.321803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:08.322453 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:08.323002 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:08.323852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:08.324470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:08.325016 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:08.484664 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:08.497706 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-370492d2-e919-477e-9621-0c5be49250ec tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.190117 Sep 02 21:39:08.498694 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 658/1281] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:08 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:09.522571 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:09.523193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:09.529745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:09.530247 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:09.530691 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:09.531399 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:09.531877 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:09.532293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:09.672552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:09.690251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a83eb24d-1c65-4d35-b217-22fcd98e93a0 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.163049 Sep 02 21:39:09.690251 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 624/1282] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:09 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:10.704947 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:10.705567 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:10.713163 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:10.713649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:10.714112 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:10.714813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:10.715268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:10.715698 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:10.718380 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:10.870069 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:10.878254 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d8030d37-65ef-44db-9195-a0b296d1ee2a tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.177211 Sep 02 21:39:10.878836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 659/1283] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:10 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:11.907515 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:11.908121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:11.914849 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:11.915316 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:11.915747 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:11.916433 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:11.916881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:11.917304 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:12.063085 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:12.071962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2f28a5a4-4b63-42de-9184-71707d6e573d tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.168220 Sep 02 21:39:12.072840 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 625/1284] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:11 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:13.099219 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:13.100071 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:13.109854 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:13.110620 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:13.111268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:13.112316 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:13.112997 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:13.113633 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:13.532716 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:13.542601 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d6dfa50e-ad0c-47e2-8739-c621753d4a93 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.449597 Sep 02 21:39:13.562527 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 660/1285] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:13 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:14.567731 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:14.568347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:14.575012 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:14.575493 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:14.575933 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:14.576630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:14.577086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:14.577518 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:14.719789 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:14.728625 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ad28dd95-ab6d-41e4-afd7-0ba44d7b0d70 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.164728 Sep 02 21:39:14.729205 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 626/1286] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:14 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:15.753498 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:15.754143 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:15.761022 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:15.761536 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:15.762010 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:15.762717 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:15.763175 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:15.763604 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:15.916576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:15.926296 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cf939253-6ab0-4d56-b446-cedd94351124 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.176736 Sep 02 21:39:15.932300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 661/1287] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:15 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:16.950675 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:16.951317 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:16.957845 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:16.958328 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:16.958767 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:16.959460 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:16.959910 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:16.960338 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:17.100366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:17.108532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-83812bcd-cf2e-4eff-8476-670ce7ca3227 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.161846 Sep 02 21:39:17.109123 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 627/1288] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:16 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:17.372121 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "name": "network-vif-plugged", "status": "completed", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:39:17.377873 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=28 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:17.383374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:17.384814 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:17.385339 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:17.397663 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] Creating event network-vif-plugged:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:39:17.403925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-e2b49add-1784-4588-80f4-e1c9da88b734 req-e5c6d14a-c978-41ae-8ce4-9ae36ef2823c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Sep 02 21:39:17.405513 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 662/1289] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:39:18.131884 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:18.132415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:18.138946 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:18.146464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:18.146464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:18.146464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:18.146464 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:18.146879 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:18.280140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:18.290121 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a1d16aa5-3096-47b0-9bc7-158e8719cf52 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.162098 Sep 02 21:39:18.305280 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 628/1290] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:18 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:19.317557 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:19.318200 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:19.325315 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:19.325875 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:19.326418 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:19.327116 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:19.327564 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:19.327986 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:19.468463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:19.476378 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f97b0212-a208-4c1e-a7dc-2c1612fc8b0b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1574 microversion: 2.1 time: 0.163628 Sep 02 21:39:19.476952 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 663/1291] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:19 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:20.504051 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:20.504788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:20.507429 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:20.513238 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:20.513837 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:20.514353 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:20.515134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:20.515694 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:20.516197 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:20.520736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:20.660358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:20.668636 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1282e5cd-66ff-4475-9df9-baecfcf1fe81 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1561 microversion: 2.1 time: 0.168415 Sep 02 21:39:20.669223 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 629/1292] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:20 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:55.274763 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:39:55.276967 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:55.279317 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:55.280013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=25 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:55.284987 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:55.286326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:55.292520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:55.292520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:55.292520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:55.292520 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:55.543484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-97c18dd3-e69b-4639-b982-a8ac354aec32 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action" status: 202 len: 0 microversion: 2.1 time: 0.273358 Sep 02 21:39:55.544039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 664/1293] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:39:55 2022] POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:39:55.553227 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:55.553871 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:55.560726 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:55.561207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:55.561641 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:55.562369 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:55.562821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:55.563244 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:55.952663 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:55.961426 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3510b095-03f0-4f5a-a35f-160d84179cc9 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1749 microversion: 2.1 time: 0.412851 Sep 02 21:39:55.962052 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 630/1294] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:55 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1749 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:56.987335 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:56.988038 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:56.994901 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:56.995413 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:56.995849 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:56.996727 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:56.997402 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:56.997864 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:57.208827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:57.215192 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-54423ba3-fe13-4d3e-9b46-301c272fe548 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.233034 Sep 02 21:39:57.215787 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 665/1295] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:56 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:39:58.239249 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:58.239928 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:58.247026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:58.247513 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:58.247978 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:58.248686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:58.249140 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:58.249566 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:58.403181 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:58.412163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-aad24542-9649-4ebd-85ae-3112ef50fa61 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.176809 Sep 02 21:39:58.412757 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 631/1296] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:58 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:39:59.436310 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:39:59.436919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:39:59.444952 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:59.445430 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:59.445888 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:59.446592 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:39:59.447044 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:39:59.447469 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:39:59.610657 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:39:59.619769 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-85d71478-0142-4e5c-9c17-9586453d1817 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.187587 Sep 02 21:39:59.620358 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 666/1297] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:39:59 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:00.648829 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:00.649422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:00.656172 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:00.656658 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:00.657190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:00.657929 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:00.658389 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:00.658821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:00.809127 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:00.817585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ed730a30-3177-4dbe-8f6e-0cc747e6e349 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.172780 Sep 02 21:40:00.818208 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 632/1298] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:00 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:01.840652 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:01.841265 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:01.848173 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:01.848596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:01.849285 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:01.850073 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:01.850543 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:01.850964 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:02.002802 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:02.011992 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7487ef87-fc41-40c5-a17a-6eac82f6ae10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.175272 Sep 02 21:40:02.012585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 667/1299] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:01 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:03.035552 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:03.036302 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:03.042677 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:03.043163 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:03.043605 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:03.044303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:03.044762 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:03.045190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:03.197490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:03.206171 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4b7bcb1a-7b49-4909-90a3-7e503349af28 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.174597 Sep 02 21:40:03.206676 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 633/1300] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:03 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:04.231302 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:04.231925 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:04.239323 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:04.239910 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:04.240353 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:04.241070 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:04.241528 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:04.242037 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:04.392417 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:04.401369 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c04347fa-8697-46ed-b637-0ed9e713f1c5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.174367 Sep 02 21:40:04.401994 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 668/1301] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:04 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:05.425320 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:05.427189 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:05.433645 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:05.434159 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:05.434600 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:05.435303 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:05.435756 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:05.436182 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:05.583551 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:05.592193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6143691-a5e8-4cca-8879-69fe8230ef7e tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.170776 Sep 02 21:40:05.592775 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 634/1302] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:05 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:06.617468 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:06.618118 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:06.624928 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:06.625410 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:06.625887 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:06.626585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:06.627043 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:06.627466 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:06.783685 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:06.792934 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3cefbbfc-8298-4308-8531-7a6781d8d690 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.180038 Sep 02 21:40:06.793517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 669/1303] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:06 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:07.816682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:07.817345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:07.823858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:07.824345 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:07.824788 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:07.825490 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:07.826010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:07.826440 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:07.970472 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:07.982886 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0e524e01-16fd-489f-82c5-fcbdf7141c10 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1754 microversion: 2.1 time: 0.170211 Sep 02 21:40:07.983581 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 635/1304] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:07 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:09.006749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:09.007344 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:09.013827 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:09.014311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:09.014751 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:09.015450 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:09.015905 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:09.016340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:09.161129 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:09.169307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c3974f9b-39ba-4d1c-8b26-6abd42c6e9bf tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1757 microversion: 2.1 time: 0.166451 Sep 02 21:40:09.169909 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 670/1305] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:09 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:55.045738 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:55.046627 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:55.049735 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=13 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:40:55.056209 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 21:40:55.058178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Fri Sep 2 21:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Sep 02 21:40:55.058178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 21:40:55.058178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Fri Sep 2 21:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Sep 02 21:40:55.059119 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=14 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:40:55.059886 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:40:55.063110 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=41 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:40:55.072136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:55.073224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:55.074594 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:55.075355 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:55.075819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:55.076248 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:55.110045 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:40:55.168388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2e2ad4-ffac-4582-9098-5ecd278a65a1", "tag": "3832cf9b-674c-496c-ad7f-65d73d0637c8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:40:55.179013 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:55.180261 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:55.180676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:55.191686 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] Creating event network-changed:3832cf9b-674c-496c-ad7f-65d73d0637c8 for instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 on hv-cinder-85221 Sep 02 21:40:55.198829 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-1fde107e-9154-4991-8474-21d3642b9571 req-b3a18fe6-93c3-4412-a7b1-f074df6447f7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147742 Sep 02 21:40:55.199653 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 671/1306] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:40:55.485261 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f72554bb-4f18-4852-86fd-1687186f5186 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 204 len: 0 microversion: 2.1 time: 0.443821 Sep 02 21:40:55.486433 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 636/1307] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:40:55 2022] DELETE /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:40:55.496668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:55.497542 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:55.504993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:55.505637 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:55.506251 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:55.507072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:55.507688 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:55.508189 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:55.662448 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:55.672555 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f26f26fc-8993-4dd3-8311-a686face06fa tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1577 microversion: 2.1 time: 0.181381 Sep 02 21:40:55.679813 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 672/1308] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:55 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:56.697215 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:56.697949 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:56.704616 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:56.705096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:56.705564 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:56.706283 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:56.706740 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:56.707158 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:56.844828 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:56.853293 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-69ff218f-6519-465a-9943-a1c75c113d95 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1577 microversion: 2.1 time: 0.161000 Sep 02 21:40:56.853897 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 637/1309] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:56 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:57.877308 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:57.877850 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:57.885420 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:57.885944 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:57.886390 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:57.887101 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:57.887750 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:57.888184 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:58.023580 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:58.032593 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-af4364e3-e978-49e7-9ba9-28dc09598fbd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1458 microversion: 2.1 time: 0.159882 Sep 02 21:40:58.033172 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 673/1310] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:57 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:40:58.307265 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2e2ad4-ffac-4582-9098-5ecd278a65a1", "name": "network-vif-deleted", "tag": "3832cf9b-674c-496c-ad7f-65d73d0637c8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:40:58.317389 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:58.317930 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:58.318415 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:58.330199 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] Creating event network-vif-deleted:3832cf9b-674c-496c-ad7f-65d73d0637c8 for instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 on hv-cinder-85221 Sep 02 21:40:58.335190 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-34700add-a5a4-4cbd-94d4-53a5382c1f2f req-18d2aeb1-2e9a-43f0-81e8-4f88d41cdbd0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114959 Sep 02 21:40:58.339913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 638/1311] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:40:59.059596 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:40:59.060205 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:40:59.066785 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:59.067264 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:59.067699 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:59.068388 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:40:59.068839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:40:59.069282 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:40:59.137484 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:40:59.145475 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0615e795-6fe0-49d0-afd4-ae91521b6fc7 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 200 len: 1226 microversion: 2.1 time: 0.090031 Sep 02 21:40:59.146089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 674/1312] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:40:59 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:00.168843 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:00.169554 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: dd2e2ad4-ffac-4582-9098-5ecd278a65a1] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:00.175725 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:00.176266 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:00.176643 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:00.177327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:00.177806 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:00.178233 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:00.192149 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] HTTP exception thrown: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Request method failure captured: Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 HTTP/1.1 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnYmDntYRco6laCLnQ3GmSIbkkO7k_nUE_-SDVyBBWuuCoN7Bb4rZmusTKXYHJSOj0xcmyOASchfkVPGUjKEDGYUsb7H7zhmdQArT3Lvqx63IgkaWhiIi6d-g6fyMTBNipKljrkQnNrXa6fMGJYLRU-eY9xroxt0AFHIAKzc9Rt-5yo Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:41:00.193820 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_beb5b0e674994eabb1e18fde391c2484", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e9450f3f7527406ab70fcf0b64cab787 Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. Sep 02 21:41:00.196499 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'dd2e2ad4-ffac-4582-9098-5ecd278a65a1'} Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:00.197665 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. Sep 02 21:41:00.205405 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:00.207743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Returning 404 to user: Instance dd2e2ad4-ffac-4582-9098-5ecd278a65a1 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:00.207743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fa85b23e-874d-411b-b814-859ecc609817 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1" status: 404 len: 111 microversion: 2.1 time: 0.031082 Sep 02 21:41:00.207743 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 639/1313] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:00 2022] GET /compute/v2.1/servers/dd2e2ad4-ffac-4582-9098-5ecd278a65a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:03.732079 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:03.732963 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:03.733921 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71a5df2-5585-4e89-9529-053e26493377", "tag": "ccaa401d-f126-4d70-8191-e1211a3942ec"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:03.742404 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:03.742668 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:03.743502 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:03.744360 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:03.744836 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:03.745050 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:03.745269 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:03.745532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:03.746011 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:03.758375 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] Creating event network-changed:ccaa401d-f126-4d70-8191-e1211a3942ec for instance e71a5df2-5585-4e89-9529-053e26493377 on hv-cinder-85221 Sep 02 21:41:03.764145 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c7152d7a-bca1-424a-bbcf-34474a7826a0 req-31bf74f5-26c5-4aaf-9312-e279a9e91ffd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033970 Sep 02 21:41:03.765200 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 640/1314] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:41:03.778387 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:41:04.109575 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5b12a775-3019-4a05-9c54-3c7a4a318431 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 204 len: 0 microversion: 2.1 time: 0.381657 Sep 02 21:41:04.110181 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 675/1315] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:41:03 2022] DELETE /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:41:04.119704 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:04.122237 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:04.127097 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:04.127597 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:04.128270 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:04.129064 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:04.129531 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:04.130000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:04.280626 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:04.289436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ff46859-15a8-47af-8709-30d98256e746 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1575 microversion: 2.1 time: 0.174159 Sep 02 21:41:04.290069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 641/1316] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:04 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:05.315603 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:05.316307 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:05.323729 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:05.324250 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:05.324689 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:05.325395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:05.325884 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:05.326312 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:05.477611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:05.485908 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d54108b8-7b1e-490e-8411-bd4e254b8315 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1457 microversion: 2.1 time: 0.174457 Sep 02 21:41:05.486509 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 676/1317] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:05 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:41:05.926963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71a5df2-5585-4e89-9529-053e26493377", "name": "network-vif-deleted", "tag": "ccaa401d-f126-4d70-8191-e1211a3942ec"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:05.938770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:05.938770 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:05.939101 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:05.951686 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] Creating event network-vif-deleted:ccaa401d-f126-4d70-8191-e1211a3942ec for instance e71a5df2-5585-4e89-9529-053e26493377 on hv-cinder-85221 Sep 02 21:41:05.957532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-7d79f36e-ea81-43fd-83bf-7dd655b8ef4c req-6f12cdb9-5eab-4f3d-95dc-c6d4cd9a7ae8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034490 Sep 02 21:41:05.958193 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 642/1318] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:41:06.511039 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:06.511926 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:06.523723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:06.523723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:06.523723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:06.523723 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:06.524452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:06.524452 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:06.596252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:06.611549 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a0781d1d-d1c6-42f2-ba6f-087e8ff3522a tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1225 microversion: 2.1 time: 0.104319 Sep 02 21:41:06.625747 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 677/1319] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:06 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:07.017174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:07.017917 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:07.020470 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:07.026898 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.027393 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.034327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.034327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.034327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.034327 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.034749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.034749 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.034924 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.050178 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] Creating event network-changed:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:41:07.058199 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:41:07.062642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a60bd386-8a3e-49b6-9fae-5d8dd2c14515 req-f1aa6b96-4550-4ca0-bb6c-f99bedd3082f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046850 Sep 02 21:41:07.063677 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 678/1320] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:41:07.460079 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-11206760-e3fe-497b-b718-361b72294913 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 204 len: 0 microversion: 2.1 time: 0.447399 Sep 02 21:41:07.464880 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 643/1321] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:41:07 2022] DELETE /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:41:07.471072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:07.471902 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:07.479508 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.480075 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.480589 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.481385 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.481949 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.482444 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.639072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:07.639072 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b9821e7b-21d6-4a2e-b3ee-56d0a0347b39 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.168596 Sep 02 21:41:07.639720 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:07.639839 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 679/1322] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:07 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:07.639934 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:07.643764 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.644235 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.644685 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.645409 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.645986 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.646422 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.680887 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:07.681376 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:07.681885 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:07.682347 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lazy-loading 'fault' on Instance uuid e71a5df2-5585-4e89-9529-053e26493377 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:41:07.730059 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:07.740681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f3168759-0dd1-4eef-8688-483ea862a5e4 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1230 microversion: 2.1 time: 0.106587 Sep 02 21:41:07.740681 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 644/1323] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:07 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:41:08.661649 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:08.662327 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:08.670606 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:08.670804 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:08.671162 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:08.672186 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:08.672985 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:08.673788 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:08.763203 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:08.764541 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:08.771568 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:08.772055 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:08.772486 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:08.773963 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:08.774766 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:08.775519 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:08.821791 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:08.822603 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:08.823221 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:08.823847 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lazy-loading 'fault' on Instance uuid e71a5df2-5585-4e89-9529-053e26493377 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:41:08.833943 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:08.842628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-595a07f6-fa82-461b-9527-90ea709563da tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1567 microversion: 2.1 time: 0.185421 Sep 02 21:41:08.843305 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 680/1324] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:08 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:08.867336 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9450f3f7527406ab70fcf0b64cab787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5b0e674994eabb1e18fde391c2484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:08.875560 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be903adb-38dd-4fc2-b78c-f80b23010ceb tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 200 len: 1184 microversion: 2.1 time: 0.116591 Sep 02 21:41:08.876165 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 645/1325] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:08 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 1184 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:09.866300 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:09.866993 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:09.868096 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc20ae9-3b10-407b-b448-fe0c5f99e264", "name": "network-vif-deleted", "tag": "6d985d2e-c30b-424c-813a-88640a59e168"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:09.874719 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:09.875233 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:09.875687 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:09.876483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:09.877089 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:09.877374 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:09.877947 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:09.878308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:09.878732 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:09.890577 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] Creating event network-vif-deleted:6d985d2e-c30b-424c-813a-88640a59e168 for instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 on hv-cinder-85221 Sep 02 21:41:09.895906 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-47544fd0-2814-4017-ba9a-a37a004e051e req-1c0cd11f-71a7-4430-ae0f-4aab57219ad2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 Sep 02 21:41:09.942559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 646/1326] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:41:09.942559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:09.942559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: e71a5df2-5585-4e89-9529-053e26493377] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:09.942559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:09.942559 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:09.943505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:09.943505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:09.943505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:09.943505 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] HTTP exception thrown: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Request method failure captured: Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 HTTP/1.1 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnYmDntYRco6laCLnQ3GmSIbkkO7k_nUE_-SDVyBBWuuCoN7Bb4rZmusTKXYHJSOj0xcmyOASchfkVPGUjKEDGYUsb7H7zhmdQArT3Lvqx63IgkaWhiIi6d-g6fyMTBNipKljrkQnNrXa6fMGJYLRU-eY9xroxt0AFHIAKzc9Rt-5yo Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:41:09.943874 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_beb5b0e674994eabb1e18fde391c2484", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e9450f3f7527406ab70fcf0b64cab787 Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. Sep 02 21:41:09.945793 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': 'e71a5df2-5585-4e89-9529-053e26493377'} Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:09.946913 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. Sep 02 21:41:09.948619 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:09.950224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Returning 404 to user: Instance e71a5df2-5585-4e89-9529-053e26493377 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:09.950224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-811d2d39-6508-4296-90b0-ef0861939ddd tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377" status: 404 len: 111 microversion: 2.1 time: 0.034012 Sep 02 21:41:09.950224 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 647/1327] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:09 2022] GET /compute/v2.1/servers/e71a5df2-5585-4e89-9529-053e26493377 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:09.963704 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:09.972234 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b5faf49d-1b65-4a0e-aaf0-2194bef460b9 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1382 microversion: 2.1 time: 0.109853 Sep 02 21:41:09.974789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 681/1328] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:09 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1382 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:10.567919 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:10.568420 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:10.575176 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:10.575667 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:10.576108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:10.576819 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:10.577301 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:10.577736 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:10.592474 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] HTTP exception thrown: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Request method failure captured: Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a HTTP/1.1 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEnYmDntYRco6laCLnQ3GmSIbkkO7k_nUE_-SDVyBBWuuCoN7Bb4rZmusTKXYHJSOj0xcmyOASchfkVPGUjKEDGYUsb7H7zhmdQArT3Lvqx63IgkaWhiIi6d-g6fyMTBNipKljrkQnNrXa6fMGJYLRU-eY9xroxt0AFHIAKzc9Rt-5yo Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:41:10.598295 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_beb5b0e674994eabb1e18fde391c2484", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: e9450f3f7527406ab70fcf0b64cab787 Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.599987 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '5c6b5d14-aed2-4682-981c-77f4c379c55a'} Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:10.600965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.603318 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.604912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Returning 404 to user: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:10.604912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ce47a45-9a4a-4467-9e65-c45fa2912fbf tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 404 len: 111 microversion: 2.1 time: 0.031640 Sep 02 21:41:10.604912 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 648/1329] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:41:10 2022] DELETE /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:10.605919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:10.606803 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] [instance: 5c6b5d14-aed2-4682-981c-77f4c379c55a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:10.613082 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:10.613576 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:10.614048 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:10.614758 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:10.615214 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:10.615640 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:10.630612 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] HTTP exception thrown: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Request method failure captured: Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a HTTP/1.1 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnYmDntYRco6laCLnQ3GmSIbkkO7k_nUE_-SDVyBBWuuCoN7Bb4rZmusTKXYHJSOj0xcmyOASchfkVPGUjKEDGYUsb7H7zhmdQArT3Lvqx63IgkaWhiIi6d-g6fyMTBNipKljrkQnNrXa6fMGJYLRU-eY9xroxt0AFHIAKzc9Rt-5yo Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:41:10.632642 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/beb5b0e674994eabb1e18fde391c2484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_beb5b0e674994eabb1e18fde391c2484", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: beb5b0e674994eabb1e18fde391c2484 Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestVolumeBootPattern-762479264 Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: e9450f3f7527406ab70fcf0b64cab787 Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestVolumeBootPattern-762479264-project Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.634411 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '5c6b5d14-aed2-4682-981c-77f4c379c55a'} Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:10.635501 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. Sep 02 21:41:10.637151 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:10.638696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Returning 404 to user: Instance 5c6b5d14-aed2-4682-981c-77f4c379c55a could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:10.638696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-66765047-2e7a-4075-9f54-c7e42196882e tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a" status: 404 len: 111 microversion: 2.1 time: 0.032639 Sep 02 21:41:10.638696 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 682/1330] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:10 2022] GET /compute/v2.1/servers/5c6b5d14-aed2-4682-981c-77f4c379c55a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:10.997358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:11.088598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:11.088598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:11.088598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:11.088598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:11.089086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:11.089086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:11.089086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:11.089086 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:11.089454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:11.089454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:11.089454 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lazy-loading 'fault' on Instance uuid 8fc20ae9-3b10-407b-b448-fe0c5f99e264 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:41:11.092748 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984fc2a59704c10905656ae32dc68af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9e8bc2976f4e2a8f439f89440bdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:11.100959 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-011bf692-504f-42bf-95c2-33080d2928ae tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 200 len: 1224 microversion: 2.1 time: 0.107928 Sep 02 21:41:11.102927 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 649/1331] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:10 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:12.126916 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:12.127483 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] [instance: 8fc20ae9-3b10-407b-b448-fe0c5f99e264] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:12.134852 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:12.135347 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:12.135789 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:12.136492 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:12.136950 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:12.137373 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] HTTP exception thrown: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Request method failure captured: Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 HTTP/1.1 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept: application/json Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Connection: close Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Length: 0 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Content-Type: application/json Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Host: 10.222.0.99 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABjEnb0Gfu5pvScGUuyNfa4b3lcrJP0QztOg_L6jdXVvfvvgzjFyApBmnTUjIaO87e9q5CoPlfceQQsRyihI7Z4WOMJNv40PPY9ic0AjWuYt0f3U2redUI1qDvAy1JBBk2Q4sIR8lX9oOtzDfc-NL6tBGgbK1EMu9xrXxmFwgtpAfJC9aI Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Id: ed9e8bc2976f4e2a8f439f89440bdaa3 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestShelveInstance-1263499564 Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Role: member,reader Sep 02 21:41:12.153835 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed9e8bc2976f4e2a8f439f89440bdaa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed9e8bc2976f4e2a8f439f89440bdaa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed9e8bc2976f4e2a8f439f89440bdaa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed9e8bc2976f4e2a8f439f89440bdaa3", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestShelveInstance-1263499564 Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ed9e8bc2976f4e2a8f439f89440bdaa3 Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestShelveInstance-1263499564 Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User: tempest-TestShelveInstance-1263499564-project Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Id: 7984fc2a59704c10905656ae32dc68af Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestShelveInstance-1263499564-project Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: method: > Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: exception: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. Sep 02 21:41:12.155643 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: action_args: {'id': '8fc20ae9-3b10-407b-b448-fe0c5f99e264'} Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:12.156552 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. Sep 02 21:41:12.157981 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Sep 02 21:41:12.159286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Returning 404 to user: Instance 8fc20ae9-3b10-407b-b448-fe0c5f99e264 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:12.159286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9db13472-5ecd-4a72-8c47-4332e4aa161b tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264" status: 404 len: 111 microversion: 2.1 time: 0.032265 Sep 02 21:41:12.159286 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 683/1332] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:12 2022] GET /compute/v2.1/servers/8fc20ae9-3b10-407b-b448-fe0c5f99e264 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:12.165792 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-37f74372-d7a5-4cb7-9f2d-d15eddbb33e8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] Calling method '.version_select at 0x7faac0db8160>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:12.288709 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-37f74372-d7a5-4cb7-9f2d-d15eddbb33e8 tempest-TestVolumeBootPattern-762479264 tempest-TestVolumeBootPattern-762479264-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1904457527" status: 202 len: 0 microversion: 2.1 time: 0.127713 Sep 02 21:41:12.289858 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 650/1333] 10.222.0.99 () {58 vars in 1263 bytes} [Fri Sep 2 21:41:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1904457527 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:41:12.422644 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b0df7152-ddf3-4ee2-b34a-28e879d8f012 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] Calling method '.version_select at 0x7faac4223670>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:12.518179 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-172801931"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:12.518715 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:12.525948 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:12.526444 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:12.526881 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:12.527612 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:12.528104 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:12.528532 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:12.533790 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b0df7152-ddf3-4ee2-b34a-28e879d8f012 tempest-TestShelveInstance-1263499564 tempest-TestShelveInstance-1263499564-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-516683868" status: 202 len: 0 microversion: 2.1 time: 0.114984 Sep 02 21:41:12.534407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 684/1334] 10.222.0.99 () {58 vars in 1251 bytes} [Fri Sep 2 21:41:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-516683868 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:41:12.787366 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.network.security_group_api [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Removing security group 63aad085-e4be-446c-b566-367e05f9ebe9 from port ae056596-48a8-487f-9e26-45fe8ab0864c Sep 02 21:41:13.498965 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4a382528-0c4d-4d5f-b313-2e99a7599348 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action" status: 202 len: 0 microversion: 2.1 time: 0.984725 Sep 02 21:41:13.500000 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 651/1335] 10.222.0.99 () {60 vars in 1278 bytes} [Fri Sep 2 21:41:12 2022] POST /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/action => generated 0 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:41:13.512545 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:13.524551 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:13.525329 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:13.525991 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:13.539772 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] Creating event network-changed:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:41:13.546019 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-afb75a4a-6589-413a-91c1-21aac6513dd5 req-7b1ad301-178e-416c-aeec-2e477d629ff6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037049 Sep 02 21:41:13.546628 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 685/1336] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:41:16.277080 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:16.277682 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:16.282103 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:16.296503 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:16.296784 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:16.297395 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:16.297572 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:16.297924 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:16.298517 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:16.301075 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:16.303598 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:16.304095 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:16.314983 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] Creating event network-changed:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:41:16.326268 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-7dd985b8-3336-4e65-9c73-3cc0ee9c1c45 req-87924439-8d4e-4a40-9ebe-04eaf3ef5653 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048885 Sep 02 21:41:16.327518 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 686/1337] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:41:16.465299 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lazy-loading 'services' on Instance uuid 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:41:16.838207 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-06064d99-d295-4f3d-bc5e-be7cd813cbf5 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments/2eaf9dec-34dc-4626-b668-0f842edac8b5" status: 202 len: 0 microversion: 2.1 time: 0.571078 Sep 02 21:41:16.839010 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 652/1338] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:41:16 2022] DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments/2eaf9dec-34dc-4626-b668-0f842edac8b5 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:41:16.848407 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:16.851474 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:16.864611 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:16.865252 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:16.866471 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:16.873283 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:16.873919 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:16.874442 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:16.947823 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1be0c07c-e3c8-4502-ad4a-efd1598b1bb7 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104037 Sep 02 21:41:16.956243 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 687/1339] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:41:16 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:41:17.966436 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:17.970522 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:18.008632 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:18.009497 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:18.009984 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:18.011404 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:18.011882 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:18.012324 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:18.047332 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:41:18.060256 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-16e8307a-73e0-48c7-8000-e9c65531cd09 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102397 Sep 02 21:41:18.061358 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 653/1340] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:41:17 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:41:19.073584 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:19.076462 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:19.082975 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:19.083464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:19.087077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:19.087077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:19.087077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:19.087077 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:19.117326 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-957fa3dc-76d0-405f-b06a-e81542010d27 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047611 Sep 02 21:41:19.117931 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 688/1341] 10.222.0.99 () {58 vars in 1302 bytes} [Fri Sep 2 21:41:19 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:41:19.133955 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:19.134482 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:19.142255 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:19.142741 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:19.143180 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:19.143876 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:19.144326 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:19.144751 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:19.232528 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] HTTP exception thrown: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 is not attached to volume 2eaf9dec-34dc-4626-b668-0f842edac8b5 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Request method failure captured: Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments/2eaf9dec-34dc-4626-b668-0f842edac8b5 HTTP/1.1 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEneTZyuvDWHTQ55sb7OFVwMh43wC7qWnm8vYq267xnw_8T5b6Kkk5miu0sBewjhoBhDAu_vsI9iFC-LUqLxiT9EwN6j6JHo7yIaTOdqoqcHCQhazq1Lo_vZNaQTRHeGQQ4jke2VutKR-2rNktkh6VbHP4XN6R3CPziUeokx7BxMg4d8 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 634952274d2748b988c4610754edc371 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:41:19.245903 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634952274d2748b988c4610754edc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634952274d2748b988c4610754edc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634952274d2748b988c4610754edc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634952274d2748b988c4610754edc371", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 634952274d2748b988c4610754edc371 Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestMinimumBasicScenario-1671314828-project Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 43fefdc28eb54c9f8401bf11b8935065 Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestMinimumBasicScenario-1671314828-project Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:41:19.247703 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 is not attached to volume 2eaf9dec-34dc-4626-b668-0f842edac8b5 Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'server_id': '42ed2a5f-6a80-4bd8-9735-8773f29d2d63', 'id': '2eaf9dec-34dc-4626-b668-0f842edac8b5'} Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2eaf9dec-34dc-4626-b668-0f842edac8b5. Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:19.248630 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 is not attached to volume 2eaf9dec-34dc-4626-b668-0f842edac8b5 Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 is not attached to volume 2eaf9dec-34dc-4626-b668-0f842edac8b5 Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:19.250430 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Returning 404 to user: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 is not attached to volume 2eaf9dec-34dc-4626-b668-0f842edac8b5 {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:19.252174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3aff0f86-a0c3-42d1-956a-2a821546eb72 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments/2eaf9dec-34dc-4626-b668-0f842edac8b5" status: 404 len: 154 microversion: 2.1 time: 0.122787 Sep 02 21:41:19.252174 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 654/1342] 10.222.0.99 () {58 vars in 1416 bytes} [Fri Sep 2 21:41:19 2022] DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63/os-volume_attachments/2eaf9dec-34dc-4626-b668-0f842edac8b5 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:20.615018 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:20.615862 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:20.623311 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:20.623796 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:20.624238 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:20.625220 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:20.625676 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:20.626244 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:20.655855 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:41:20.693455 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:41:21.042304 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-97992201-bb66-4e2b-89e1-aaddaffde999 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 204 len: 0 microversion: 2.1 time: 0.430929 Sep 02 21:41:21.043627 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 689/1343] 10.222.0.99 () {58 vars in 1239 bytes} [Fri Sep 2 21:41:20 2022] DELETE /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:41:21.052962 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:21.054041 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:21.062305 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:21.063191 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:21.064108 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:21.065557 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:21.066134 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:21.066821 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:21.256009 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:21.266234 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-955e7ae2-fadd-4846-9610-a099e59c404c tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1553 microversion: 2.1 time: 0.218184 Sep 02 21:41:21.282314 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 655/1344] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:21 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:22.299868 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:22.302401 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:22.321408 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:22.322656 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:22.323340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:22.324490 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:22.325130 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:22.325891 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:22.733525 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:22.742135 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9f2b8452-4609-4f79-8d4c-ec4bc28009f6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1553 microversion: 2.1 time: 0.453929 Sep 02 21:41:22.750569 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 690/1345] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:22 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1553 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:23.765865 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:23.766585 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:23.780411 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:23.781078 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:23.786026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:23.786026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:23.786026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:23.786026 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:23.801585 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ed2a5f-6a80-4bd8-9735-8773f29d2d63", "name": "network-vif-deleted", "tag": "ae056596-48a8-487f-9e26-45fe8ab0864c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:41:23.830999 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:23.835463 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:23.836590 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:23.886464 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] Creating event network-vif-deleted:ae056596-48a8-487f-9e26-45fe8ab0864c for instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 on hv-cinder-85221 Sep 02 21:41:23.895631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-dfacd726-9acf-481b-a47f-9cdf9629bda4 req-6ac7d36b-523c-4a75-b2fc-b7dfb7a7a630 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099587 Sep 02 21:41:23.895631 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 691/1346] 10.222.0.99 () {64 vars in 1317 bytes} [Fri Sep 2 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:41:24.012043 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:24.038651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5268f857-f88f-4752-903a-ef43057af549 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1511 microversion: 2.1 time: 0.262862 Sep 02 21:41:24.038651 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 656/1347] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:23 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:25.051406 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:25.052324 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:25.063797 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:25.064284 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:25.064895 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:25.065605 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:25.066577 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:25.067063 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:25.102303 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:25.102894 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:25.103340 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:25.103837 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lazy-loading 'fault' on Instance uuid 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:41:25.149166 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fefdc28eb54c9f8401bf11b8935065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634952274d2748b988c4610754edc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:41:25.156398 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7dd1008b-0966-4c98-81c9-c9ebd3de4024 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 200 len: 1347 microversion: 2.1 time: 0.109780 Sep 02 21:41:25.157263 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 692/1348] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:25 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:41:26.184136 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:26.184757 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] [instance: 42ed2a5f-6a80-4bd8-9735-8773f29d2d63] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:41:26.188069 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:41:26.191901 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:26.192308 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:26.192745 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:26.193451 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Acquiring lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:41:26.194063 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:41:26.194498 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Lock "ee6d477e-b8ad-480a-9130-23ff2ba2795f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:41:26.217138 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] HTTP exception thrown: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Request method failure captured: Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 HTTP/1.1 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept: application/json Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Connection: close Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Length: 0 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Content-Type: application/json Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Host: 10.222.0.99 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.12 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjEneTZyuvDWHTQ55sb7OFVwMh43wC7qWnm8vYq267xnw_8T5b6Kkk5miu0sBewjhoBhDAu_vsI9iFC-LUqLxiT9EwN6j6JHo7yIaTOdqoqcHCQhazq1Lo_vZNaQTRHeGQQ4jke2VutKR-2rNktkh6VbHP4XN6R3CPziUeokx7BxMg4d8 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Id: 634952274d2748b988c4610754edc371 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Role: member,reader Sep 02 21:41:26.219151 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Roles: member,reader Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634952274d2748b988c4610754edc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634952274d2748b988c4610754edc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634952274d2748b988c4610754edc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634952274d2748b988c4610754edc371", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}] Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 634952274d2748b988c4610754edc371 Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671314828 Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User: tempest-TestMinimumBasicScenario-1671314828-project Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Id: 43fefdc28eb54c9f8401bf11b8935065 Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestMinimumBasicScenario-1671314828-project Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: method: > Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: exception: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. Sep 02 21:41:26.220692 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: action_args: {'id': '42ed2a5f-6a80-4bd8-9735-8773f29d2d63'} Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:41:26.221578 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. Sep 02 21:41:26.223032 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Sep 02 21:41:26.225890 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Returning 404 to user: Instance 42ed2a5f-6a80-4bd8-9735-8773f29d2d63 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:41:26.227638 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d02b8109-657e-4a20-a1ba-57798e9bf472 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63" status: 404 len: 111 microversion: 2.1 time: 0.048338 Sep 02 21:41:26.228569 dv-cinder-852211-9-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 657/1349] 10.222.0.99 () {58 vars in 1236 bytes} [Fri Sep 2 21:41:26 2022] GET /compute/v2.1/servers/42ed2a5f-6a80-4bd8-9735-8773f29d2d63 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:41:26.237131 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-205fc9d0-8a71-4770-b236-54cef81ba2e6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] Calling method '.version_select at 0x7faac44280d0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:41:26.244744 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:41:26.332443 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-205fc9d0-8a71-4770-b236-54cef81ba2e6 tempest-TestMinimumBasicScenario-1671314828 tempest-TestMinimumBasicScenario-1671314828-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98727817" status: 202 len: 0 microversion: 2.1 time: 0.099165 Sep 02 21:41:26.333027 dv-cinder-852211-9-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 693/1350] 10.222.0.99 () {58 vars in 1266 bytes} [Fri Sep 2 21:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98727817 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)